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(5^ Incasecontlnuouereproduction iscommanded 
from a first AV stream to a second AV stream, a third AV 
stream, made up of a preset portton.of ttie first AV 
stream and a preset portton of the second AV stream, 
is generated. The third AV stream Is reproduced when 
reproduction Is switched from the first AV stream to the 
second AV stream. As the Infomiatlon pertinent to the 



third AV stream, the address Infomnatlon of a source 
packet of the first AV stream at a timing of switching from 
the first AV stream to the third AV stream and the ad-. 
. dress Infonmatlon of a source packet of the second AV 
stream at a timing of switching from the third AV stream 
to the second AV stream, are generated. This enables 
reproduction such as to nialntaln continuity between 
separately recorded AV streams. 
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Dajterlption 

Technical Field 



[0001 ] This Invention relates to an Information processing method and apparatus, a program, and a recording medium 
and, more particularly, to an Information processing method and apparatus, a program and a recording medium, con- 
figured for maintaining continuity of moving pictures In a reproducing domain. 



Bacltground Art 

iO 

[0002] Recently, a variety of types of optical discs have boon proposed as a recording medium that can be removed 
from a recording apparatus. Those recordable optical discs have been proposed as a large capacity medium of several 
QBs and are thought to be promising as a medium for recording AV (audio visual) signals, such as video signals. 
Among the digital AV signal sources (supply sources), to be recorded on this recordable optical diso, there are CS 
IS digital satoiilte broadcast and BS digital broadcast. Additionally, the ground wave television broadcast of the digital 
system has also boon proposed for future use. ^ ^ ^ uocr^ 

[00031 The digital video signals, supplied from these sources, km routinely compressed under the MPEG (Moving 
Piclure Experts Group) 2 system, in a recording apparatus, a recording rate proper to the apparatus Is set. If digital 
video signals of the digital broadcast are recorded In the conventional Image storage rnediums for domestic use, digital 
so video signals are first decoded and subsequently bandwidth-limited for recording, in the case of the digital recording 
system Including, of course, the MPEG1 Video, MPEQ2 video and The present invention provides an DV systems, 
digital video signals are first decoded and subsequently re-encoded in accordance with an encoding system for the 
recording rate proper to the apparatus for recording subsequently. „ ^ w 

[00041 However, this re«sordlng system, in which the supplied bitstream is decoded once and subsequently band- 
wWth-llmHed and re-encoded prior to recording, suffers from deteriorated piclure quality, tf. In recording compressed 
video dialtal signals, the transmission rate of Input digital signals is less than the recording rate for the recording and/ 
or reproducing apparatus, the method of directly recording the supplied bitstream without decoding or w-wwodlng 
suffers from deterioration In the picture quality only to the least extent. However. If the tran«nlS8lon rate of the Input 
digital signals exceeds the recording rate of the recording and/or reproducing apparatus It Is 
efy»de ttie bitstream and to record the so-re-encoded bitstream. so that, after decoding In the recording and/or repro- 
ducing apparatus, the transmission rate will be not higher than the upper limit of the disc recording rate. 

The blti^tream is iransmltiedinavariableratesystemin which 
S??2rered X«me. the capacity of the recording medium can be exploited less wastefuliy In the ^» 
rJ^t^ppM adapted tor transiently storing data In a buffer and for recording the data •» « ^umUaahton than 
In the case of a lapo recording system having a fixed recording rate imposed by the fixed rpm of tiie rotaof head^ 
rooOBl Thus, it may be predicted that. In the near future when the digital broadcast Is to become the mainstream, an 
incraasing demand wHI be ralsedfor a racording and/or reproducing apparatus in which broadcast 
as Sgitai signals, without decoding or re-encoding, as in a data streamer, and in which a disc Is used as a recording 

ZSSoil"" in reproducing data recorded on a recording medium In the above^lescribed recording apparatus, there Is 
known so-called sidp reproduction In which reproduction is continued up to a preset picture and a pictura. temporally 
sS apartfrom the preset plctur» Is reproduced next. This skip raproductlon has a drawback that temporal continuity 
Is lost in the reproduced pictures. 

45 Disclosure of the invention 

[00081 itisthereforeanobjectofthepreeentlnventtontoenablereproductlonsuchaatomalntaincontinuityotmoving 

roSlw* TiISpS82iH!lven«!Jn"provWes an infonnatlon processing apparatus Including generating means for gener- 
» atlng In case continuous reproduction from a firat AV stream to a second AV stream is commanded a mird AV «ream 
ma£ up^t SwSt portlwTof the fimt AV stream and a preset portion of the second AV stream, the ^l<[^^^^^ 
being r^roduced when reproduction Is switched from the firat AV stream to the second AV stream, and the address 
inforniatlon.astheihfom,ationpertinenttothethlrdAVstream.theaddresslnfbrmatlonbe 

on an addr^ of a source packet of the firat AV stream at a timing of awtehing of reproduction from the firet AV stream 
55 to the third AV stream, and of the Infonnatlon on the address of a source packet o1 the second AV .J"' 
of switching of reproduction from the third AV stream to the second AV stream, and recording means for recording the 
third AV stream and the address infonnatlon. as generated by the generating means. 

[oS5 pSiiibiy.anarrlvaltimest^ 
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generated by the generating means, and an arrival time stamp of a source packet located at a leading end of the third 
AV stream, are continuous to each other, and an an^lval time stamp of the source packet of the second AV stream 
Included in the address^ Infomnatlon generated by the generating means and an arrival time stamp of a source packet 
located at a trailing end of the third AV stream are contlnupus to each other. 

[0011] Preferably, a sole discontinuous point exists In the arrival time stamp of the source packet In the third AV 
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Stream. 

[0012] Preferably, the address Is determined so that a data portion of the AV stream previous to a source packet 
specified by the infomiatlon on the addresis of the source packet of the first AV stream contained In the address infor- 
mation generated by the generating means will be located in a. continuous area of not less than a preset size on a ' 
to recording medium. 

[001 3] Preferably, the address Is detenmined so that a data portion of the AV streem subsequent to a source packet 
specified by the Infoimatton on the address of the source packet of the second AV stream contained in the address 
Infomiation generated by the generating means will be located In a continuous area of not less than a preset size on 
a recording medium. 

IS [0014] Preferably, the third AV stream is generated so that the third AV stream will be located in a continuous area 
of hot less than a preset size on the recording medium. 

p)01 5] The present Inventton also provides an Infomiatlon generating method Including a step of generating. In (pase 
continuous reproduction from a flr&l AV stream to a second AV stream is commanded, a third AV stream made up of 
a preset portion of the first AV stream and a preset portion of the second AV stream, the third AV stream being repro- 
duced when reproduction Is switched from the first AV stream to the sojond AV strearn, and a step of generating the 
address InfoimaBon, as the.infomiation pertinent to the third AV stream, the address infonmatk>n being made up of the 
information on an address of a source packet of the first AV stream at a timing of switching of reproduction from the 
first AV stream to the third AV stream, and of the Information ori the address of a source packet of the second AV 
stream at a timing of switching of reproduction from the third AV stream to the second AV stream. 
[001 6] The present bvention also provides a recording medium having recorded thereon a computer-readable pro- 
gram in which the program includes a step of generating, In case continuous reproduction from a first AV stream to a 
second AV stream is comrrianded, a third AV stream made up of a preset portion of the first AV stream and a preset 
portion of the second AV stream, the third AV stream being reproduced when reproduction is switched from the first 
AV stream to the second AV stream, and a step of generating the address infonmatton, as the Infonnailon pertinent to 
so the third AV stream, the address Infomiation being made up of the infomrmtton on an address of a source packet of 
the first AV stream at a timing of switching of reproduction from the first AV stream to the third AV stream, and of the 
infomiation on the address of a source packet of the second AV stream at a timing- of switching of reproduction from 
the third AV stream to the second AV stream. «ui^K.K««r^ro,« 
100171 Thepresent invention also provWes a program for having a connputer execute a program, in which the program 
includes a step of generating, in case continuous reproduction from a first AV stream to a second AV stream is com- 
rnanded. a third AV stream made up of a preset portion of the first AV stream and a preset portion of the second AV 
stream, the third AV stream bfeing reproduced when reproduction Is switched from the first AV stream to the second 
AV stream, and a step of generafing the address infomiatlon. tfs the infomiation pertinent to the third AV stream, the 
address information being made up of the information on an address of a source packet of the first AV stream at a 
timing of switching of reproduction from tho first AV stream to the third AV stream, and of the Information on the address 
of a source packet of the second AV stream at a timing of switching of reproduction from the third AV stream to the 

SmI? The orient invention also provides an infonmation processing apparatus Including first readout means for 
reading out a first AV stream, a second AV stream or a third AV stream from a recording medium, second readout 
moans for reading out. as the Information pertinent to the third AV stream, the information on an address of a source, 
packet of the first AV stream at a timing of switching of reproduction from the first AV stream to the third AV stream, 
andottheinformattonontheaddressofasourcepacketofthesecondAVstreamatatimingofswItchlngofre 

from the third AV stream to ttie second AV stream, and reproducing means for perfonning reproduction as reproduction 
is switched from the first AV stream read out by the first readout means to the third AV stream and from the third AV 
60 stream to the second. AV stream, based on the information pertinent to the ttiird AV stream road out by ttie second 

[00191^ ™e"present inventton also provkJes an Infomiatlon processing method Including a first readout controlling 
step of reading out a first AV stream, a secorid AV stream or a third AV stream from a recording medium, a second 
readout OontrolHng step of reading out. astiie intonnation pertinent to the third AV stream, the information on an address 
56 of a source packet of the first AV stream at a timing of switching of reproductton from the first AV streanrt to the third 
AV stream, and of the Infomiatlon on the address of a source packet of the second AV stream at a timing of switching 
of reproduction from the tti Ird AV.stream to the second AV stream, and a reproducing step of perfomnlng reproductton 
as reproductton Is switched from the first AV sti-eam read out by tiie first readout means to the third AV stream and 
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• from the third AV 6tream to the second AV stream, based on the infomnatlon pertinent to the third AV stream read out 
by the second readout means. 

[0020] The present Invention also provides a recording medium having recorded thereon a computer-readable pro- 
gram. In whtoh the program Includes a first readout controlling step of reading out a first AV stream, a second AV stream 

9 or a third AV stream from a recording medium, a second readout coi^trolllng step of reading out. as the tnfonnatlon 
pertinent to the third AV stream, the Information on an address of a source packet of the first AV stream at a timing of 
switching of reproduction from the first AV stream to the third AV stream, and of the fnfonmalion on the address of a 
source packet of the second AV stream at a timing of switching of reproduction from the third AV stream to the second 
AV stream, and a reproducing step of perfomnlng reproduction as reproduction is switched from the first AV stream 

10 read out by the first readout means to the third AV stream and from the third AV stream to the second AV stream, based 
on the Inf onmatk>n pertinent to the third AV stream read out by the second readout means. 

[0021] The present invention also provides a programfor haying a computer execute aprogram. in which the program 
includes a first readout controlling step of reading out a first AV stream, a second AV atream or a third AV stream from 
a recording medium, a second readout controlling step of reading oul, as the information pertinent to the third AV 

w stream, the infomnatlon on an address of a source packet of the first AV stream at a timing of switching of reproduction 
from the first AV stream to the third AV stream, and of the Infonnation on the address of a source packet of the second 
AV stream at a timing of switching of reproduction from the third AV stream to the second AV stream, and a reproducing 
step of performing leproductton as reproduction Is switched from the first AV stream read out by the first readout means 
to the third AV stream and from the third AV stream to the second AV stream, based on the information pertinent to 

so the third AV stream read out by the second readout means. 

[0022] The present Invention also provides a recording medium having recorded thereon the address Infomiatkjn 
Including, in case continuous reproduction from a first AV stream to a second AV stream is commanded, a third AV 
stream made up of a preset portion of the first AV stream and a preset portion of the second AV stream, the third AV 
stream being reproduced when reproduction Is switched from the first AV stream to the second AV stream, and the 

25 address Information, as the Infomiatlon peitlnerSt to the third AV stream, the address infonmatk>n being made up of the 
information on an address of a source packet of the first AV stream at a timing of switching of reproduction from the 
first AV stream to the third AV stream, and of the Infonnatlon on the address of a source packet of the second AV 
stream at a timing of switching of reproduction from the third AV stream to the second AV stream. 
[0023] in the information processing method and apparatus, and the program, according to the present Invention, If 

30 the It Is commanded to perform reproduction continuously from the first AV stream to the second AV stream, there Is 
generated a third AV stream-made up of a preset portion of the first AV stream and a preset portion of the second AV 
stream and whteh Is reproduced when reproduction la switched from the first AV stream to the second AV stream, while 
there is generato<), as the Infomnatlon pertinent to the third AV stream, the address lnfonmatk>n made up of the Infor- 
mation on an address of a source packet of the first AV sueam at a tinriing of switching of reproduction from the first 

35 AV stream to the third AV stream, and of the Infonnallon on the address of a source packet of the second AV stream 
at a timing of switching of reproduction from the third AV stream to the second AV stream. 

[0024] In the Information processing nnethod and apparatus, and the program, according to the present Invention, a 
first AV stream, a second AV stream or a third AV stream is read out from a recording medium, the address Infonnatlon 
made up of the Information on an address of a source packet of the first AV stream at a timing of switohing of reproduotion 

40 from the first AV stream to the third AV stream, and the infonmatlon on the address of a source packet of the second 
AV stream at a t^lng of switching of reproduction from the third AV stream to the second AV stream, is read out from 
the recording medium as the infomnatlon pertinent to the third AV stream, and reproduction is switched from the first 
AV stream to the third AV stream and from the third AV stream to the second AV stream, as reproduction proceeds, 
based oh the read-out Information pertinent to the third AV stream. 

45 [0O2B] Other objects, features and advantages.of the present invention will become more apparent from reading the 
embodiments of the present Invention as shown In the drawings. 

Brief Description of the Drawings 

so [0026] 

Flg.i shows a configuration of an embodiment of a recording and/or reproducing apparatus according to the present 
Invention. 

Flg.2 Illustrates the data format of data recorded on a recording nnedlum by a recording and/or reproducing appa- 
55 ratusL 

Flg.3 illustrates Real PlayList and Virtual Play List. 

Figs.4A. 4B and AC Illustrate the creation of the Real PlayList. 

Flgs.5A, 5B and 6C Illustrate deletion of the Real PlayList. 
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Fig8.6A and 6B illustrate assemble editing. 
Flg.7 illustrates provision of a sub path in ttie Virtual PiayList 
Flg.8 illustrates ttie changing of the ptayback sequence of the PiayList. 
Fig.9 illustrates a mark on the PiayList and a mark on the Clip. 
5 Fig.1 0 illustrates a menu thumbnail, 

Fig.11 illustrates mark added to the PiayList. 
Fig.l2 Illustrates a mark added to the Clip. 

Flg.ld illustrates the relatton between the PiayList, Clip and the thumbnail file. 

Fig.1 4 Illustrates a directory structure. 
io Flg.1 5 Illustrates a syntax of inf r.dvr. 

Fig.1 6 shows a syntax of DVHVolume. 

Flg.1 7 shows a syntax of ResumeVolume. 

Rg.1 8 shows a syntax of UlApplnfoVolume. 

Fig.1 9 shows a table of character set values. 
t5 Fig.20 shows a syntax of TableOf PiayList. 

Flg.21 shows another syntax of IfeibleOf PiayList, 

Flg.22 shows a syntax of the MakersPrivateData. 

Fig.23 shows a syntax of xxxx.rpis and yyyy.vpls. 

Flg8.24A to 24C Illustrate the PiayList 
20 Fig.25 shows a syntax of PiayList. 

Flg.26 shows a table of PlayLlst_type. 

Flg.27 shows a syntax of UlApplnfoPlayLlst. 

Fig8.28A to 28C illustralB flags In the UlApplnfoPJayUst syntax shown in Fig.27 

Flg.29 illU6t^^tes a Playltem. 
25 . Fig.30 Illustrates a Playltem. 

Flg.31 illustrates a Playltem. 

Fig.32 shows a syntax of the Playltem. 

FIg.33 illustrates IN-time/ 

Fig.34 iNustrates OUT-time. 
30 Fig.35 shows a table of Connectlon_Condltk>n. 

Figs .36 A to 38D Illustrate Connection.Condltton.. 

Fig.37 Illustrates BridgeSequencelnfo. 

Fig.38 shows a syntax of BridgeSequencelnfo. 

Fig.39 Illustrates SubPlayltem. 
59 Flg.40 shows a syntax of SubPlayltem. 

FiS.41 shows a table of Mark.type. 

Fig.42 shows a syntax of PlayLlstMark. 

Flg.43 shows a table of Mark-type. 

Fig.44 illustrates Mark_tlme_stamp. 
40 Flg.46 shows a syntax of zzzzz.ciip. 

Flg.46 shows a syntax of Cliplnfo. 

Flg.47 shows a table, of Cilp^stream^tifpe. 

Fig.48inustrBtesoffset.SPN. 

Flg.49 Illustrates offset^SPN. 
45 FIgs.SOA, 50B Illustrate the STC domain. 

Rg.51 Illustrates STC_lnfo. 

Flg,62 shows a syntax of STC^Info. 

Fig.53 Illustrates Programlnfo.. 

Fig.54 shows a syntax of Programlnfo. 
00 Flg.55 shows a syntax of VldeoCondlnglnfo. 

Fig.56 shows a table of Video Jormat 

Flg.57 shows a table of frame_rate. 

Flg.68 shows a table of dleplay_aspect_ratio. 

Fig.59 shows a syntax of Audk>Condinglnfo. 
55 Flg.80 shows a table of audlo.codlng. 

Fig.61 shows a table of audlo_component_type. 

Fig.82 shows a table of samptlng.frequency. 

Flg.83 Illustrates CP1. 
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Rg.64 illustrates CPl. 
Flg.65 shows a syntax of CPl. 
Fig.66 shows a table of CPl.type. 
Flg.67 Illustrates viddo EP.map. 

9 Flg.68 inustrates EP_map. 
Fig.69 inustrates EP.map. 
Flg.70 shows a syntax of EP_map. 

. Fig.71 shows a table of EP^typavalues. 
Flg,72 shows a syntax of EP.map_for_one_8tream.PID. 

10 Flg.73 Hlustrates TU^nriap. ' 
Flg.74 shows a syntax of TU^nuip. 
Flg.76 shows a syntax of ClipMark. 
Rg76 shows a table of Mark.type. 

Fig. 77 shows a table of Mar1<_type_8tamp. 
'5 Flg.76 shows a syntax of menu.thmb and marlc.thmb. 

Flg.79 shows the syntax of thumbnail. 
Flg.BO shows a table of thumbnaH _plcture.format. 
Figs.81 A and 81 Blllustrate tn Jblock. 

Fig.82 Illustrates a structure of a transport stream of DVR MPEG2. 
20 Flg.83 shows a recorder model ot a transport stream of DVR MPEG2. 

Flg.64 shows a player model of a transport stream of DVR MPEG2. 

Fig.85 shows the syntax of a source packet. 

Flg.86 shows the syntax of TP_extra.header. 

Flg.67 shows a table of a copy pemnlssion Indicator. 
25 Fig.68 Illustrates seamless connectk>n. 

Fig.dd Illustrates seamless connection. 

Flg.90 illustrates seamless connection. 

Flg.91 illustrates seamless connection. 

Flg.92 illustrates seamless connection. 
30 Fig.93 Illustrates audio overlap. 

Fig.94 Illustrates seamless connection employing BrldgeSequence. 

Flg.95 Illustrates seamless connection not employing BrldgeSequence. 

Flg.96 shows a DVR STD model. 

Flg.97 Is a timing chart for decoding and display. 
38 Flg.96 shows another syntax of BridgeSequencelnfo. 

Flg.99 illustrates Brldge.Clip when two Playltems are seamlessly connected. 

Ftg.1 00 shows a syntax of a Clip Information file. 

Fig.ioi shows a syntax of a Cliplnfo of the Clip Information file of Flg.100. 

Fig.1 02 shows a syntax of a Sequencetnfo of the Clip Infomnatlon file of Flg.1 00. 
40 Figs.l 03A and 1 03B illustrate database change In case stream data of the Clip AV stream file is partially erased. 

Flg.1 04 is a flowchart for Illustrating the preparation of a RealPlayLlst 

Fig.105 Is a fk>wchart for illustrating the formulation of a Virtual PlayLlst. 

Flg.1 06 is a f towchart for illustrating the fomnuiation of a bridge sequence. 

Fig.1 07 Is a flowchart for Illustrating the reproduction of PlayLlst, 
45 Flg.lOBlllustrBtes a medium. 

Best Mode for Carrying out the Invention 

[0027] Refen-lng to the drawings, present embodiment of the present Invention will be explained In detail. Rg.1 shows 
so a typical inner structure of a recording and/or reproducing apparatus 1 ennbodying the present Invention. First, the 
structure of a recording unit 2, configured for recording signals input from outside, Is explained. The recording and/or 
reproducing apparatus 1 Is configured for being fed with and recording analog or digital data. 
[002B] Analog video signals and analog audio signals are fed to temntnals 11,12, respectively. The video signals, 
Input to the terminal 11 . are output to an analysis unit 14 and to an AV encoder 15. The audio signals, Input to the 
«5 terminal 12. are output to the analysis unit 14 and to the AV encoder 15. The analysis unit 14 extracts feature points, 
such as scene changes, from the input video and audio signals. 

[0029] The AV encoder 1 5 encodes Input video and audio signal to output the system information (S), such as an 
encoded video stream (V), an encoded audio stream (A) and AV synchronization, to a multiplexer 16. 
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[0030] The encoded video stream is a video stream encoded e.g., with the MPEG (Moving Picture Expert Group) 2 
system, whilst the encoded audio stream Is an audio stream encoded In acconiance witfi the MPEG1 system, with the . 
encoded audio stream being e.g., an audio stream encodisd in e.g., the MPEG1 system or an audio .stream encoded 
in accordance with the Dolby AC3 (trademak) systeni. The multiplexer 1 6 muttlplexes the input video and audio streams, 
based on the Input system information, to output a multiplexed stream through a switch 17 to a multiplexed stream 
analysts unit 1 8 and to a source packellzer 19. . 

[0031] The multiplexed stream Is e.g., an MPEG-2 transport stream or an MPEG2 program stream. The source 
packetlzer 19 encodes the input multiplexed stream Into an AV stream conrtposed of source packets In accordance 
with an application fomnat of a recording nnedium 100 on whtoh to record the stream. The AV stream is processed In 
ECC (en-or con-ectton and coding) unit 20 and a nr^odulatlon unit 21 with appendage of ECC codes and with modulation, 
before being output to a write unit 22, whk?h then writes (records) an AV stream file based on a control signals output 
by the controller 23. 

[0032] The transport stream, such as digital television broadcast, input frorri a digital Interface or a digital television 
tuner, is ln|3Ut to a temiinai 1 3. There are two recording systems for recording the transport stream input to the temiinal 
13, one being a transparent recording system and the other being a system in which recording is preceded by re- 
encoding aimed to lower e.g.. the recording bit rate, the recording system command informatton is input from a terminal 
24 as a user interface to a controller 23. 

[0033] In the transparent recording of the Inpui transport stream, a transport stream, input to a tenninal 13, is output 
through a switch 17 to a multiplexed stream^analysis unit 1 8 and to the source packetlzer 19. The ensuing processing 
of recording an AV stream on a recording medium is the same as that of encoding and recording analog Input audio 
and video signals, as described above, and hence Is not explained here for simplicity. 

P034] If the input transport stream is re-encoded and subsequently recorded, the transport stream. Input to the 
terminal 1 3, Is fed to a demultiplexer28, which demultiplexes the input transport stream to extract a video stream (V), 
an audio stream (A) and the system infomiation (S). 

[0035] Of the stream (Infonnation), as extracted by the demultiplexer 26, the video stream is output to an audio 
decoder 27, whilst the audio stream and the system. Information are output to the multiplexer 16. The audio decoder 
27 decodes the input transport stream to output the encoded video stream (V) to the multiplexer 16. 
[0036] The audto stream and the system Information, output from the demu Itiplexer 26 and input to the multiplexer 
16, and the video stream, output by the AV encoder 15, are multiplexed, based on the input system Infomiatton, and 
output to the multiplexed stream analysis unit 18 and to the source packetlzer .19 through switch 17. as a multiplexed 
stream. The ensuing processing of recording an AV stream on a recording nwdlum is the same as that of encoding 
and recording analog Input audio and video signals, as described aboyO: and hence not explained here for simpltelty. 
[00371 The recording and/or reproducing apparatus i of the preserit embodiment records a file of the AV stream on 
the recoWlng medium 100, while also recording the applteatlon database Infomnatlon which accounts for the file. The 
input Information to the controller 23 Is the feature infomiation for the moving pteture from the analysis unit 14, the 
. feature Information of the AV stream from the multiplexed stream analysis unit 18 and the user comnnand infomnatlon 
input at a terminal 24. ^ , i 

[0038] The feature Information of the moving pteturisi. supplied from the analysis unit 1 4, Is generated by the analysis 
unit 14 when the AV encoder 15 encodes video signals. The analysis unit 14 analyzes the contents of the input video 
and audio signals to gorierato the information pertinent to the pictures characteristic of the input moving pteture signals 
(clip mark). This Information is the infomnatton indicating a picture of characteristic clip mark points, such as program 
start points, scene change points. CM commercial start and end points, title or telop In Input video signals, and also 
irrdudes a thumbnail of the picture and the irifomnation pertinent to stereo/monaural switching points and muted portions 
of audio signals. 

[0039] The above picture indicating information Is fed through controller 23 to the multiplexer 18. When multiplexing 
a encoded picture specified as clip mark by the controller 23, the multiplexer 16 retums the Infonmatlon for specifying 
the encoded picture on the AV stream to the controller 23. Specifically, this infomwtion is the PTS (presentation time 
. stamp) of a picture or the address infomiation on the AV stream of an encoded version of the picture. The controller 
23 stores the sort of feature pictures and the Inf onnation for specifying the encoded picture on the AV stream in asso- 
ciation with each other. 

[0040] The feature Information of the AV streiam froni the multiplexed stream analysis unit 18 Is the Information 
pertinent to the encoding information of the AV stream to be recorded, and Is recorded by an analysis unit 18. For 
example, the feature infomiatlon includes the time stamp and address infomiation of the l-picture in the AV stream, 
discontinuous point Information of system time clocks, encoding parameters of the AV stream and change point Infor- 
mation of the encoding parameters In the AV stream. When transparently recording the transport stream, input from 
the terminal 13. the multiplexed stream analysis unit 18 detects the picture of the aforementioned clip mark, from the 
input transport stream, and generates the Information for specifying a picture designated by the clip martc and its type. 
[0041] The user deslgnatton Infonnaillon from the tenninal 24 Is the infomiatlon specifying the playback domain, 
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designated by the user, character letters for explaining the contents of the playback domain, or the Infomiatlon such 
as bookmarks or resuming points set by the user for his or her favorite scene. 

[0042] Based on the aforementioned Input Intormatlon, the controller 23 creates a database of the AV stream (Clip), 
a database of a group (PlayLlst) of playback domains (Playltem) of the AV stream, management Information of the 
5 recorded contents of the recording medium 100 (Info.dvi) and the Information on thumbnail pictures. Similarly to the 
AV stream, the application database Information, constructed from the.above Infomiatlon, Is processed In the ECC unit 
20 and the modulation unit 2 1 and Input to the write unit 22, whteh then records a database file on the recording medium 
100. 

[0043] The above-described applteatlon database infonnatlon will be explained subsequently In detail. 

10 [0044] When the AV stream file recorded on the recording medium 1 00 (files of pksture data and speech data) and 
the application database information, thus recorded on the recording medium 100. are reproduced by a reproducing 
unit 3, the controller 23 first commanda a readout unit 28 to read out the application database Infonmation from the 
recording medium 1 00. The readout unit 28 reads out the applteatlon database infonnatlon from the recording medium 
1 00, which then reads out the application database Infonnatlon from the recording medium 1 00 to send the application ' 

15 database infonnatlon through demodulation and en-or conrectlon processing by a demodulating unit 29 and an. ECC 
decoder 30 to the controller 23. 

[0045] Based on the application database Infomnatlon, the controller 23 outputs a list of PlayLlat recorded on the 
recording medium 1 00 to a user Interface of the temnlnai 24. The user selects the PlayLlst. desired to be reproduced, 
from the list of PlayLists. The Infonnatlon pertinent to PiayUst. specified to be reproduced. Is input to the controller 23. 
20 The controller 23 commands the readout unit 28 to read out the AV stream file necessary In reproducing the PlayLlst. 
In accordance with the command, the readout unit 28 reads out the con^espondlng AV stream from the recording 
medium 100 to output the read-out AV stream to the demodulating unit 29. The AV stream, thus Input to the demodu- 
lating unit 29, Is demodulated by preset processing and output through the processing by the ECC decoder 30 to a 
source depacketlzer 31. ^ *u 

2s [0048] The source depacketlzer 31 converts the AV stream of the application fomnat, read out from the recording 
medium 1 00 and processed In a preset fashion, Into a stream processable by the demultiplexer 26. The demultiplexer 
26 outputs the system Information (S), such as the video stream (V), audio stream (A) or the AV synchronization, 
forming the playback domain (Playltem) of the AV stream specified by the controller 23. to the audio decoder 27. whtoh 
AV decoder 27 decodes the video stream and the audio stream to output the playback video signal and the playback 
so audio signal to associated terminals 32, 33, respectively. 

[0047] If fed from the terminal 24. as a user Interface, with the Infonnatlon instructing random access playback or 
special playback, the controfler 23 determines the readout position of the AV stream from the recording inedlurn 1 oo 
based on the contents of the database (Clip) of the AV stream, to command the readout unit 28 to road out the AV 
stream If the PlayLlst as selected by the user is to be reproduced as from a preset time point, the controller 23 corn- 
as mands the readout unit 26 to read out data from an l-plcture having a time stamp ctosesl to the specified time point. 
[0048] When the user has selected a certain clip mark from Indexing points or scene change points for the program 
stored in the Cllpl^rk in the Clip information, as when the user selects a certain picture from a list of thumbnail pictures, 
as demonstrated on a user Interface, of the indexing points or scene change points stored In the ClipMark. the controller 
23 detennlnes the AV stream readout position from the recording medium 100 to command the readout unit 28 to read 
40 out the AV stream. That Is, the controller 23 commands the readout unit 28 to read out data from an l-plcture having 
en address closest to the address on the AV stream which has stored the picture selected by the user. The readout 
unit 28 reads out data from the specified address . The read-out data is processed by the demodulating unit 29, ECC 
decoder 30 and by the source packetlzer 1 9 so as to be supplied to the demultiplexer 26 and decoded by the audio 
decoder 27 to reproduce AV data Indicated by an address of the mark point picture. 
45 [0049] If the user has commanded fast f onward playback, the controller 23 commands the readout unit 28 to sequen- 
tlally read out l^^icture data in the AV stream In succession based on the database (Clip) of the AV stream. 
[0050] The readout unit 28 reads out data of the AV stream from a specified random access point. The so read-out 
data Is reproduced through processing by various components on the downstream side. 

[0051] The case In whteh the user edits the AV stream recorded on the recording medium 1 00 Is now explained. If. 
30 desired to specify a playback domain fdrthe AV stream recorded on the recording medium 1 00. for example. If desired 
to create a playback route of reproducing a portion sung by a singer A from a song program A, and subsequently 
reproducing a portion sung by the same singer A from another song program B, the Infomrtatlon pertinent to a beginning 
point (IN-point) and an end point (OUT-poInt) of the piaybeck domain Is input to the controller 23 from the terminal as 
a user interface. The controller 23 creates a database of the group (PlayLlst) of playback domains (Playltem) of the 
* 55 AV streams. 

[0052] When the user desires to erase a portion of the AV stream recorded on the recording medium 1 CO, the infor- 
mation pertinent to the IN-poInt and the OLTT-point of the erasure domain Is Input to the controller 23. which then 
. modifies the database of the PlayLlst so as to refer to only ti^e needed AV streams. The controller 23 also commands 
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the write unit 22 to erase an unneeded stream portion of the A 

[0053] The case In which the user desires to specify playback domains of an AV stream recorded on the recording 
medlurn to create ia new playback route, and to Interconnect the respebtive playback domains In a seamless fashion, 
is now explained, In such caise, the controner23 creates a databaso of a group (Play List)- of the. playback domains 
5 (Ptayrtern) of the AV stream and undertakes to. partially re-encoda and re-multiplex the video streeun in the vicinity of 
junction points of the playback domains. 

[0054] The picture Infomriatton at the IN-poInt and lhat at the OUT-poInt of a playback domain are Input from a terminal 
24 to a controller 23. The controller 23 commands the readout unit 28 to read out data needed to reproduce the pictures 
at the IN*polnt and at the OUT-point. The readout unit 26 reads out data from the recording, medium 1 00. The data so 

10 read out Is output through the deiTiodulating unit 29,. £CC decoder 30 and the source packetlzer 1 9.to the demultiplexer 

" . 26. ■ ■ ' ' ' • ■ ' - * . 

[0056] The controller 23 analyzes data input to the demultiplexer 28 to determine the re-encodIng method for the 
video stream (change of plcture^coding^type and assignment of the quantity of encoding bits for re-encod|ng) and thQ 
re-multiplexing system to send the system to tlie AV encoder 15 and to the rrw^ 

15 . [0056] the demultiplexer 26 then separates the input stream Into the video stream (V), audio stream (A) and.the 
system infomiatioii (S). The video stream may be classed into data Input to the audio, decoder 27 and data Input to 
the multiplexer. 16. The fonmer Is data needed for.re-encodlhg, and Is decoded by the audio decoder 27, with the 
decoded picture being then re-encoded by the AV encoder 15 and thereby caused to become, a video stream. The 
tatter data is data copied from an original strearn. without re-encoding. The audio stream and the system intdrmatlon 

20 are directly input to the multiplexer 16. 

[0057] The multiplexer 1 6 multiplexes, an Input stream, based on the Intormation Input from the controller 23, to output 
a multiplexed stream, whteh lis processed by the ECC unit 20 and the modulation unit 21 so as to be sent to the write 
unit 22. The write unit 22 records an AV stream on the recording medium 100 based on the control signals supplied 
from the controller 23. 

29 [0058] the application database information and the operation based on this Information, such as playback and . . 
editing, are hereinafter explained, Flg.2 shows the structure of an application format having two layers, that Is PlayLlst 

and Cllp» for AV stream management. The Volume Ihfomnatlon manages all aips and PlayLlsts in the disc. Here, one 
AV stream and the ancillary infomtatfon thereof, paired together, Is deemed to be an pbject. and Is tenmed Clip. The • 
AV stream fUo is termed a Clip AV stream file, with.the ancillary information being temned the Clip ir^fonnatlon file. . 

30 [0059] One Clip AV stream/file stores data corresponding to an MPEG-2 transport stream anranged in a structure . 
prescribed by the applteatloh ifomriat. By and large, at He Is treated as a byte string. The contents of the Clip AV stream • 
file are expanded on the time axis, with entry points in the Clip (l-jpicturej being niainly specified on the time basis. 
When a time stamp of an access point to a preset Clip Is given, the piip information file Is useful In finding the address 
Infomiatlon at which to start data readout In the Clip AV stream file. 

35 [0080] Referring to Flg.3, PlayLlst is now explained, which js provided tor a user to select a playback domain desired 
to be viewed from t^ie Clip and to edit tlie playback domain readily. One Play List Is a set of playback domains In the 
Clip; One playback domain Iri a preset Clip is tenrned Playltem and Is represented by a pair of an IN-point and an OUT- 
pplnt on the time axis. So, the. PlayLlst Is foimed by a set of ptural Playltems. . 

[0081] The PlayLlst classified Into two types, one of which Is Real PlayUst and the other of which is Virtual PlayLlst.. 
40 The Real PlayLlst co-owns stream portions of the Clip It fe refereiiclng. That Is, the Real PlayLlst takes up In the disc 
the data capacity corresponding to a stream portion of the Clip It Is referencing arid, when Real PlayLlst Is erased, the 
data. of the stream portion of the Clip it Is referencing is also erased. 

[0082] The Virtual PlayLlst Is not co-owning Clip data. Therefore. If the Virtual PlayLlst Is changed or erased, the 
contents of the Clip are In no way changed. 
45 [0083] Th^ editing of the Real PlayUst Is explained. FIg.4A shows creation of Real PlayLlst and, if the AV stream js 
recorded as a new Clip, the Real PlayLlst which references the entire Clip Is a newly created operation. 
[0O84] Flg.4B shows the division of the real PlayLlst, that Is the operation of dividing the Real PlayLlst at a desired 
point to split the Real PlayLlst In.two Real PlayLlsts. This division opiBratlon is performed when two programs are 
managed In one dip managed by a sole PlayLlst arid when the user Intends to re-register or re-record the programs 
so as separate Indivlc^ai programs. This operation do^s not lead to altefration of the Clip contents, that Is to division of 
the Clip Itself. 

[0085] Flg.4C shows the cbcribinlng operation of the Real PlayLlst which Is the operation of combining two Real ■ 
PlayLlsts into one new Real PlayList. This combining operation is performed sgch as when the user desires to m- 
register two programs as a sole program. This ojderatton does not lead to alteration of the Clip contents, that is to 
55 combining the clip Itself Irito one. 

[0086] Fig.SA shows deietidn of the entire Real PlayUst. If th^ pperatton of erasing the entire preset Real PlayUst. 
the associated stream portion of the Clip referenced by the deleted Real PlayUst is also deleted. 
[0087] FIg.SB shows, partial deletion of the Reail PlayLlst. If a desired portion of the Real PlayLlst is deleted, the 
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associated Playltem Is altered to reference onjy the needed Clip stream portion. The corresponding streann portion of 
the Clip Is deleted. 

[0068] Fig.SC shows the nr^lnlnnizing of the Real PlayUst. It Is an operation of causing the Playltem associated with, 
the Real PiayList to reference only the stream portion of the Clip needed for Virtual PlayLlat. The corresponding stream 

9 portion of the Clip not needed for the Virtual Play List Is deleted. 

[0069] If the Real PiayList Is changed by the above-described operation such that the stream portion of the Clip 
. referenced by the Real PiayList is deleted, there Is a possibility that the Virtual PiayList employing the deleted Clip Is 
present such that problems may be produced in the Virtual PlayUst due to the deleted Clip. 

[0070] In order to prevent this from occurring, such a message which runs: "If there exists the Virtual Play List ref- 

10 erencing the stream portion of the Clip the Real PiayList Is referenolng» and the Real PiayList Is dejeted. the Virtual 
PiayList Itself \a deleted - Is it all right?" Is displayed for the user In response to the user's operation of deletion by way 
of confirmation or alarmingi after which the processing for deletion is executed or oanoelled subject to user's commands. 
Altematlvely, the minimizing operation for the Real PiayList Is performed In piece of deleting the Virtual PiayList. 
[0071] The operation for the Virtual PiayList is now explained, if an operation is perfonned for the Virtual PiayList, 

15 the contents of the Clip are not changed. Figs, 6A and SB show the assembling and editing (IN-OUT editing). It Is an 
operation of creating Playltem of the playback domain the user has desired to view to create Virtual PiayList. The 
seamless connection between Playltems Is supported by the application format, as later explained. 
[0072] If there exist two Real PlayLlsts 1 . 2 and clips 1 , 2 associated with the respective Real PlayLists. the user 
specifies a preset domain In the Real PiayList 1 (domain from INI to QUT1: Playltem 1) as the pilayback domain, and 

20 also specifies, as the domain to be reproduced next, a preset doniain In the Real PiayList 2 (domain from IN2 to 0\JT2: 
Playltem 2) as the playback domain, as shovvn in Flg.6A, a sole Virtual PiayList made up of Playltem 1 and the Playltem2 
is prepared, as shown In Flg.6B. 

[0073] The re-edltlng of the Virtual PiayList is now explained The re-edltlng may be enumerated by alteration of IN- 
or OUT points in the Virtual PiayList, Insertion or appendage of new Playltems to the Virtual PiayList and delation of 

3 Playltems In the VlrtuiBl PiayList. The Virtual PlayUst itself may. also be deletM^ 

[0074] Flg.7 shows the audio dubl^lng (post recording) to the Virtual PiayList. It Is an operation of registering the 
audio post recording to the Virtual PiayList as a sub path. This audio post recording Is supported by the apptlcatbn 
software. An additional audio stream Is added as a sub path to the AV stream of the main path of the Virtual PiayList. 
[0075] Common to the Real PiayList and the Virtual PiayList is an operation of changing (moving) the playback 

30 sequence of the PlayUst shown In Flg.8. This operation Is an alteration of the playback sequence of the PiayList In the 
disc (volume) and is 8U|:>ported by TabieOf PiayList as defined in the application fomiat, as will be explained subse- 
quently with reference to e.g., Fig.20. This operation does not lead to alteration of the Clip contents. 
[0076] The nriarK (Mark) is now explained. The mark Is provided for specifying a highlight orcharactertstks time In the 
Clip and in the PiayList, as shown In Flg.9. The mark added to the Clip Is termed the CIlpMark. The CllpMark Is e.g., 

S5 a program indexing point or a scene change point for specifying a characteristic scene ascrlbabte to contents in the 
AV stream. The ClipMark Is generated by e.g., the analysis unit 14 of Fig.1 . When the PiayList Is reproduced, the mark 
of the Clip referenced by the PiayList may be referenced and used. 

P077] The mark appended to the PiayList is tenmed the PlayLtstMark (play list mark). The PlayLlstMark Is e.g., a 
bookmark point or a resuming point as set by the user. The setting of the mark to the Clip and to the PlayLlist ie t>y 
40 adding a time stannp Indicating the mark time point to the mark list. On the other hand, mark deletion is removing the 
time stamp of the mark from the mark list. Consequently, the AV stream is in no way changed by mark setting or by 
mark deletion. 

[0078] As another formait of the CllpMark, a picture referenced by the ClipMark may be specified on. the address 
basis in the AV stream. Mark setting on the Clip is by adding the addre8S.basl8 Information indlcatingthe pteture of the 
45 mark point to the mark list. On the other hand, marie deletion Is removing the address basis infomiation indicating the 
mark point pknure from the mark list. Consequently, the AV stream Is in no way changed by mark setting or by mark 
deletion. 

[0079] A thumbnail is now explained. The thumbnail is a stiil picture added to the Volume, PiayList and Clip. There 
are two sorts of the thumbnail, one of them being a thumbnail as a representative picture indlcatingthe contents. This 

so Is mainly used In a malri picture In order for the user to select what the or she desired to view on acting on a cijrsor, 
not shown. Another sort of the thumbnail is a picture indicating a scene pointed by the rnark. 
[0O8O] The Volume and the respective PlayLlsts need to own representative pictures. The representative pictures 
of the Volume are presupposed to be used for initially demonstrating a still pbturs reprcfseritlng the disc contents when 
the disc Is set In position In the recording and/or reproducing apparatus 1 . It Is noted that the disc means the recordirig 

59 msfdlum 1 00 which Is presupposed to be a of disc shape. The representative picture of the PiayList Is presupposed to 
be used as a still picture for representing PiayList contents. 

[0081 1 As the representative picture of the PiayList, it may be contemplated to use the Initial ptoture of the PiayList 
as the thumbnail (representative picture). IHowever, the leading picture at the. playback time of 0 is not necessarily an 
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optimum picture representing the contents. So, the user Is allowed to set an optional picture as a thumbnail of the 
PlayUst. TWO sorts of the thumbnails, that is the thumbnail as a representative picture Indicating the Volume and the 
thumbnail as a representative picture Indteatlrig PlayList» are ternied. menu thumbnails. Since the menu thumbnails 
are demonstrated frequently, these thumbnails need to be read out at an elevated speed from the disc: Ttius/lt Is 
efficient to store the totality of the nrwnu thumbnails In a sole file. It Is unnecessary tor the menu thumbnails to be 
pictures extracted from the moving pictures In the volume, but may be a picture' captured from a personal computer or 
a digital still camera, as shown In Fig. 10. 

[0082] On the other hand, the Clip and the PlayLlst need be marked with plunal marks, whilst the pictures of the nnark 
points need to be reacHly viewed In order to grasp the contents of the mark positions. The pteture Indteating such mark 
point Is temied a mark thumbnail. Therefore, the picture whtoh is the original of the mark thunibnail Is mainly an extracted 
mark point picture rather than a picture captured from outside. 

[0083] Flg.11 shows the relation between the mark affixed to the PlayLlst and the mark thumbnail, whilst Fig. 12 
shows the relation between the mark affixed to the Clip and the mark thumbnail. In distinction from the menu thumbnail , 
the mark thumbnail is used In.e.g,, a sub-menu for representing details of the PlayLlst, vyhile it Is not requested to be 
read out In a short access time. So. whenever a . thumbnail Is required, the recorcling and/or reproducing apparatus 1 
opens a ffle and reads out a portton of the file, while there Is no problem presented even If file opening and readirig 
out a portion of the file by the recording and/or reproducing apparatus 1 takes some time. 

[0084] For decreasing the number of files present In a volume. It Is preferred for the totality of the mark thunrA>nails 
to be stored In one file. While the PlayLlst may own one menu thumbnail and plural nr^ark thumbnails, the user Is no; 
20 required to select the Clip directly (usually, the Clip Is selected through PlayLlst). and herice there Is no necessity of 
providing menu thumbnails. . • ^ ^» . ... 

[0085] Fig 13 shows the relation between the menu thumbnails, mark thumbnails, PlayLlst and Clips. In the menu 
thumbnail file are filed menu thumbnails provided from one PlayLlst to another, In the rhenu thumbnail file is contained 
a volume thumbnail representing the contents of data recorded on the disc. In the menu thumbnail file are filed thumb.- 
25 nails created from one PlayLlst to another and from one Clip to another, ' ' 

• [00861 The GPI (Characteristic Point Infomnatlon) Is hereinafter explained. The CPI is data contained In the Clip 
inf omiation file and is used mainly for finding a data address in the Clip AV stream file at whteh to start the data readout 
when a tirne Stamp of the access point to the CI?) Is afforded. In the present embodlmer)t two sorts of the CPI are used, 
one of them being EP_map and the other being TU_map. ^ ' * 

30 [0087] The EP.map is a list of entry poim (EP) data extracted from the elementary stream 

This has the address Information used to find the site of entry points ln.the.AV stream at which to start the decoding, 
one EP data is made up of a presentation time stamp (PtS) and a data address In the AV stream of the accessing 
unit associated with the PTS, with the data address being paired to the PTS. ; , 

r00881 The EP map IS used mainly for two purposes. First. It Is used f orflnding a data address in the AV strearn In 
the accessing unit referenced by the PTS in the PlayLlst. Second, the EP.map Is used for fast fon^rard playback or 
fast reverse playback. If, In i^corxilngthe input AV stream by the recording and/or reproducing apparatus 1 , the syntax 
of the stream can be analyzed, the EP:„map is created and recorded on the disc. ^ i,;^ 

r00891 The TU_mab has a list of time unit (TU) data whteh Is derived from the an^lval time point of the transport packet 
Input through a digital Interface. This affords the relatiori between the arrival^time-based time and the data address In 
the AV stream. When the recording apd/or reproducing apparatus 1 records an Input AV stream, and the syntax of the 
stream cannot be analyzed, a TU_map Is created and recorded on the disc. . , 

[0090] The ^Clnfo stores the discpntlnuous point infomrwtion in the AV stream file which stores the MPEG-2 trans- 

rao9?i'^^\A^^ the AV stream has discontinuous points of STC. the same PTS values may appear in the AV^ream 
45 file Thus, if a time point in the AV stream Is specified on the PTS basis, the PTS pf the access polrit Is Insuffiden to 
specify the point. Moreover, an index of the continuous STC domain containing the PTS is required, in this formaUhe 
continuous STC domain and Its Index are temned an STC-sequence and STC-sequence-ld, respectively. The STC- 
sequence information is defined by the STCInfo of the Clip Infomnation file. . . -n, 

[0092] The STC-sequence-id is used in an AV stream file and is optional In the AV stream file having the TU_map. 
90 [0093] The programs are each a colleclton of elementary streams and co-own a sole system t^^ 

nized reproduction of these streams. '^.--v*,, ♦u-. 

[00941 It Is useful for a reproducing apparatus (recording and/or reproducing apparatus 1 of Rg. 1) to know the 
contents of an.AV stream prior to Its decoding. These contents Include e.g., values of the PID of a transport packet 
transmitting an audio or video elementary stream or the type of the video or audio components, such as HDTV video 
55 or MPEGr2 AAC audio stream, this inf onmatlon is useful for creating a menu screen toy illustrating to the user the 
contents of the PlayLlst referericing the AV stream, it is similarly useful for setting the Initial state of the AV decoder 
and the demultiplexer of the respective apparatus. . ^ / 

[0095] For this reason, the Clip Information file owns Progremlnfo for illustrating the program contents. 
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[0096] It may be an occurrence that program contents be changed In the AV stream file In which the MPEG'2 transport 
stream. Is stored.. For example, the PID of the transport packet transmitting the video elementary stream may be ' 
changed, or the component type of the video stream may be changed from SDTV to HDTV. 
[0097] ThB Programlnfo stores the Infomnatlon on change points of program contents In the AV stream tile. The 
5^ domain of the AV stream file In which the program contents remain constant Is temned program-sequence. 

[0096] This program-sequence is used In an AV stream file having EP.map and Is optional In an AV stream file 
having TU_map, 

[0099] The present embodiment defines the self-encoding stream torrnat (SESF). The SESF Is used for encoding 
analog input signals and for decoding digital input signals for subsequently encoding the decoded signal Into an MPEG- 
10 2 transport stream. 

[01 00] The SESF defines an elementary stream pertinent to the MPEG-2 tranepprt stream and the AV stream. When 
the recording and/or reproducing apparatus 1 encodes and recoifde Input signals in the SESF, an EP.map is created 
and recorded on the disc. 

[0101] A digital broadcast stream uses one of the followlrig systems for recording on the recording medium 100: 
15 First, the digital broadcast stream is transcoded Into an SESF stream, in this case, the recorded stream must confomn 
to SESF and EP_map must be prepared and recorded on the disc. 

[0102] AitematTveiy, an elementary stream fonriing a digital broadcast stream Is transcoded to a new elementary 
stream and re-muitlplexed to a new transport stream conforming to the stream format prescribed by the organization 
for standardizing the digital broadcast stream. In this case, an EP_map must be created and recorded on the disc. 
20 [0103] For example. It Is assumed that the Input stream Is an MPEQ-2 transport stream conforming to the ISDB 
(standard appeiiatlon of digital BS of Japan), with the transport stream containing the HDTV video stream and the 
MPEG AAC audio stream. The HDTV video stream Is transcoded to an SDJV video stream, which SDTV video stream 
and the original AAC audio stream are re-multipiexed to TS. The SDTV stream and the transport stream both need to 
conform to the ISDB tomnat. 

S5 ' [0104] Another system of recording the digital broadcast stream on the recording medium 1 0O Is to make transparent 
recording of the Input transport stream, that Is to record the Input transport stream unchanged, In which case the 
EP map Is fomnulated and recorded on the disc. , ^ 

[0108] Alternatively, ttie Input transport stream Is recorded transparently, that Is an Input transport stream is recorded 
unchanged, In which case TU_map is created and recorded on the disc. 

so [0106] The directory and the file are hereinafter explained. The recording and/or reproducing apparatus 1 Is herein- 
atter described as DVR (digital vfdeo recording). Rg;l 4 shows a typical directory structure on the disc. The directories 
of the disc of the DVR may be enumerated by a root directory including "DVR- directory, and the "DVR" directory, 
including -PLAYLlST' directory. XLIPINF" directory. "M2TS" directory and "DATA" directory, as shown in Rg;14. Al- 
though directories other than these may be created below the root directory, these are discounted In the application 

05 format of Ihe present embodiment. .. ^ *, t 

10107] Below the "DATA'' dlTBCtory. there are stored all files and directories prescribed by the DVR application f omnat. 
The "DVR" directory Includes four directories. Below the "PLAYLIST" directory are placed Real PlayUst and Virtual 
PlayLlst database files. The latter directory may exist In a state devoid of PlayLlst. 

[0106] Below "CLIPINF" Is placed a Clip database. This directory, too. may exist In a state devoid of AV stream files. 
40 in the "DATA" directory, there are stored files of data broadcast, such as digital TV broadcast. 

[0100] The "DVR" directory stores the following files: That Is. an "Into.dvr-' is created below the DVR directory to store 

the comprehensive Information of an application layer.. Below the DVR directory, there must be a sole Info.dvr, The 

filename Is assumed to be fixed to Info.dvr. The "menu.thmb" stores the Inf onrtation pertinent to the menu thumbnails. 

Below the DVR directory, there must be 0 or1 mart< thumbnail. THe filename is assumed to be fixed to "menu.thmb". 
45 If there Is no menu thumbnail, this file may not exist. ' 

[01 1 0] The -mari(.thmb- file stores the infomnatlon pertinent to the maric thumbnail picture. Below the DVR directory. 

there must be 0 or 1 mark thumbnail. The filename Is assumed to be fixed to "menu.thmbV If there Is no menu thumbnail . 

raiVl]f "rhe^'^PL/^^^^^ directory stores two sorts of the PlayList files which are Real PlayLlst and Virtual PlayLlst. 
so An "xxxxx.rpls" file stores the Infonnatlon pertinent to one Real PlayUst. One file is created fpr each Real PlayLlst, The 
filename Is "xxxxx.rpls", whel^ "xxxxx" denotes five numerical figures from 0 to 9. A f lis extender mu6t be "rpis". 
[0112] The "yyyyy.vpis" stores the Infonmatlon pertinent to one Virtual PlayLlst. One file with a filename "yyyyy.vpis" 
Is created from one Vlrtuai PlayLlst to another, where "yyyyy" denotes five numerical figures from 0 to 0. A flieextender 
must be "vpis". 

» [0113] The "CLIPINF" directory stores one file In association with each AV stream file. The "zzzzz.clpl" Is a Clip 
Information file corresponding to one AV stream file (Clip AV stream file or Bridge-Clip stream file). The filename Is. 
''zzzzz dpi", where "zzziz" denotes five numerical figures from 0 to 9. A file extender must be "cIpiV 
[01 14] The 'WTS" directory stores an AV stream f He. The "zzzzz.m2t8" file Is an AV stream file handled by the DVR 
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system. This is a Clip AV stream tile or a BrIdge-CIlp AV stream file. The filename Is "zzzzz.m2t8", where "zzzzz* 
denotes fKre numerical figures from 0 to 9. A file extender must be ■m2ts^ 

[0115] The "DATA" directory stores data transmitted trom data broadcasting. Thus data may, for example, be XML 
or MPEG files. 

[01 161 The syntax and the semantics of each directory (file) are now explained. Fig. 1 5 shows thef syntax of the "Into.. 
dvr*flle. The "Info.dvr" file Is made up of three objects,. that is pVRVoume(), TableOfPlayLlstsQ and MakersPrivateData 

(). • ■•. 

[0117] Thesyntax of Info.dvr shown in Fig.15 is explained. The TableOfPlayLists„Start_address indicates the leading 
address of the tablbOfPlayUsts() In tenrw of the relative number of. bytes frorn the.leading byte of the "ihfo.dvr" file. 
The relative number of bytjBs Is counted beginning from 0. 

[0118] The MakerePrhfatebata^Stert.address Indicates the leading address of the MakersPrivateDataQ. in terms 
of the relative number of bytos as from the leading byte of the "info.dvr* file. The relative number of bytes is counted 
from 0. The paddlng^word Is Inserted In association with the syntax pf 'Info.dvr*. N1 and IM2 are optional positive 
IntegeiB. Each padding word may assume an optional value. 

[0119] . The DVRVolumeO stores the information stating the contents of the volume (disc). Flg,16 shows the syntax 
of the DVRVolumo. The syntax of the DVRVolume(). shown In Fig.1 6, is now explained. The verslon_r}umber Indicates 
four character l^em Indkrtlng the version numbers of the DVRVolumeO, The verslon^number is encoded to "doos' in 
association with IS0846. ; - 

[0120] Length is denoted by 32-bit unsigned integers indteating the number of bytes fronn directly after the length 
field to the tralHng end of DVRVolumeO- 

[0121] The ResumeVolumeO memorizes the filename of the Real PlayList or the Virtual PiayList reproduced last In 
the Volume. However, the playback position when the user has interrupted playback of the Real PlayList or the Virtual 
PlayList is stOfBd in the resume-rriark defined In the PlayLlstMarkO (see Figs.42 and 43), 

[0122] Fig.17 shows the syntax of the ResumeVclumeO. The syntax of the ResumeVolumeO shown In Fig.17 is 
explained. The valid Jlag Ihdkjates that the resume^PlayList^name field Is yajld or invalid wheh this 1^-blt flag Is set to 
1 or 0, respectively. 

[0123] The 1 0-byte fiekJ of resume_PlayUst_name indicates the filename of the Real PlayList or the Virtual PlayList 

to be resumed. . \^ 

[0124] The UlApplnfoVolume in the syntax of the DVRVolumeO, shown in Fig. 16, stores parameters of the user 
interface application concerning the Volume, Fig. 18. shows the syntax of the IJIApplnfoVolume, the semantics of whtoh 
are now explained. The e^3it field of characterl_set Indicates the encoding method for character letters encoded in the 
Volume^name field. The encoding method conresponds to the values shown in Fig.19. 

[0125] The 8-brt field of the namejength indicates the byte length of the Volume name Indteated In the Volume^name 
field The Volume.name field Indteates the appellation of the Volume. The number of bytes of the number of the 
namejength counted from left of the field Is the number of valid t^araclers and Indicates the volume appellation. The 
values next following these valid character letters may be any values. 

[01 26] The Volume^protect flag is a flag Indicating whether or not the contents in the Volume can be shown to the 
user wtthout limitations. H thfe flag lb set to 1 . the contents of the Volume are allowed to be presented (reproduced) to 
the user only In case the user has succeeded in correctly lnputtlr>g. thef PIN number (passwonj). If this flag Is set to O, 
the contents of the Volume are allowed tobe presented to the user even In case the PIN nunr^er Is not input by the user 
[0127] If. vyhen the user has Inserted a disc Into a player, this flag has beeh set to 0, or the flag is set to 1 but the 
user has succe^ed Inconwtiy inputtingthe PIN number, the recording and/or reproducing apparatus 1 demorwtrates 
a list of the PlayList in. the disc. The limitations on reproduction of the respective PlayLists are Irrelevant to the 
Volume protect Jlag and are Indicated by playback.6ontrolJiag defined In the UlApplnfoVolume. 
[0128] "The PIN is made tip of four numerical figures of from 0 to 9. each of which Is.coded In accordance with ISO/ 
lEC 648 The ref Jhumbnailjndex field indicates the infonnatlon of a thumbnail pteture added to the Volume. If ^e 
ref_thumbnalljndex field Is of a value other than OxFFFF. a thumbnail picture Is Qdded to the Volume. The thumbnail 
picture is stored in a menu.thumbflle. The picture is referenced using the value of the ref JhunU)nallJndex In the menu, 
thumb ffle. If the ref Jhumbnall Jndex field Is OxFFFF, it Indicates that a thumbnail pteture has been added to the Volume. 
[01291 The TableOfPlayLlstO In the Info.dvr syntax shown in Flg.15 is explained. The-TabieOfPlayLlstO stores the 
filename; of the PlayList (Real PlayList and Virtual PlayUst). All PlayList files recorded In the Volume are contained In 
the TableOfPlayLlslp. whteh TableOfPlayLlstO Indicates the playback sequence of the default of the PlayList In the 

pi30]^ Fig.20 shows the syntax of the TableOfPlayLlstO. whteh is now explained. The version^number of the Tabte- 
OfPlayLlstO Indicates four character letters indicating the version numbers of the TableOf PlayLists. The 
. version_nurT*>er must be encoded to "0045' In accordance with ISO 646. 
[01311 Length is a unsigned 32-bit Integer indicating the number of bytes of the. TableOfPlayLlstO from directly after 
the length field to the trailing end of the TableOfPlayLlstO- The 16-blt field of the number^of.PlayLlsts Indicates the 
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number o1 loops of the f oMoop Inclusive of the PiayLisU He.name. Thle numerical figure must be equal to the number 
of PlayLlsts recorded In the Volume. The 10-byte numerical figure of the PiByLlst.file_hame indicates the filename of 
the PlayLlsts. 

[0132] Rg.21 shows another configuration ofthe syntax of the TabieOf PleyListO. The syntax shown in Fig.21 Is com- 

9 prteed of the syntax shown In Flg.20 In which Is contained the UlAppinfoPlayLlst. By such structure including the 
UlApplnfoPlayList, it becomes possible to create a menu picture simply on reading out the TableOfPlayLlsts. The 
following explanation is premised on the use of the syntax shown in Flg.20. 

[0133] The MakersPrlvateData In the Info.dvr shown In Fig. 16 is explained. The Makers PrIvateData is provided to 
permit the maker of the recording and/or reproducing apparatus 1 to Insert private data of the maker in the MakersPri- 

10 vateDataO for special appilcatlone of different companies. The private data of each maker has standardized maker_ID 
for tdentiiying the maker who has defined it. The MakersPrivateDataO may contain one or more maker^lD. 

[0134] If a preset maker intends to insert private data, and the private data of a different maker Is already contained 
in the MakersPrivateDataO, the new private data is added to the MakersPrivateDataO without erasing the pre-existing 
old private data. Thus, In the present embodiment, private data of plural nwkers can be contained in one MakersPri- 

19 vateData(). 

[0136] Fig.22 shows the syntax of the MakersPrlvateData. The syntax of the MakersPrlvateData shown ln .Flg.22 Is 
explained. The version_number of theTableOf PlayLlstO Indicates four character letters Indtoating the verston numbers 
of the TableOfPlayLlsts. The verston.number must be encQded to "0046" In accordance with ISO 846. Length Is a 
unsigned 32-blt Integer Indicating the number of bytes ofthe DableOfPlayLlstO from directly after the length field to the 

20 trailing end of the MakersPrivateDataO. 

[0136] The mpd_blocks_8tart_addre8s Indicates the leading end address of the first mpd_block() in terms of the 
relative number of bytes from the leading byte of the MakersPrivateDataO. The number^of^maker^entrles la the 1 6-blt 
codeless Integer affording the number of entries of the maker private data Included in the MakersPrivateDataO. There 
must not be present two or more maker private data having the same maker_IO values in the MakersPrivateDataO. 

29 [0137] The mpd^blocks^size is a 1 6-blt unsigned integer affording one mpd^block size in tenms of 1 024 bytes as a 
unit. For example, if mpd_block_slze = 1, it. indteates that the size of one mpd^block Is 1024 bytes. The 
number^of.mpd^blocks Is a 1 6-blt unsigned integer affording the number of mpd.blocks contained In the MakersPri- 
vateDatat)."The makerJD Is the 16-blt unsigned integer indicating the model number code of the DVR system which 
has created the maker private data. The value encoded to the maker^lD Is specified by the licensor 

30 [0138] The maker^modeLcode Is a 16-bit unsigned Integer indicating the model number code of the DVR system 
whteh has created the maker private data. The value encoded to the maker^model.code is set by the maker who has 
received the iksense o1 the fonmat The 8tart_mpd.block_number Is a 1 8-bit unsigned Integer indksating the number of 
the mpd^block number at which begins the maker private data. TTie leading end of the maker private data must be 
aligned with the leading end of the mpd_.block. The start^mpd^block^number corresponds to a variable J in the for- 

39 loop of the mpd_biock. 

[0139] The mpdjength is a 32-bit unsigned Integer Indteating the size of the maker private data. The mpd^block Is 
an area In which Is stored maker private data. All of the mpd^biocks in the MakersPrivateDataO must be of the same 

[0140] The real PlayUst file and the Virtual PlayList file, in other words, xxxxx.rpis and yyyyy.vpis, are explained. 

40 Fig.23 shows the syntax of xxxxx.rpis (Real PlayList) and yyyyy vpls (Virtual Playli.ist), whtoh are of the same syntax 
structure. Each of the xxxxx.rpis and yyyyy.vpis Is made up of three objects, that. Is PlayLlst(), PlayLlstMarkO and 
MakersPrivateDataO- 

[0141] The PlayU8tMark_Start_addre8s Indicates the leading address of the PlayLlstMarkO, In temis of the relative 
nurnber of bytes from the leading end of the PlayList file as a unit. The relative number of bytes Is counted from zero. 
49 [0142] The Maker8Pr|vateData_Start.addres8 Indicates the leading address of the MakersPrivateDataO. in terms 
of the relative number of bytes from the leading end of the PlayList file as a unit. The relative number of bytes is counted 
from zero. ' 

[0143] The paddlng„word (padding word) Is Inserted In accordance with the syntax of the PlayList file, with N1 and 
N2 being optional positive Integers. Each padding word may assume an optional value. 
90 [0144] PlayList wlii be. further explained in the following although it has been explained briefly. A playback domain 
In all Clips except Bridge-Clip must be refenwl by all PlayLlsts In the disc. Also, two or more Real PlayLlsts must not 
overiap the playback domains shown by their Playitems in the same Clip. 

[0145] Reference is made to Fig8.24A, 24B and 24C. For all Clips, there exist corresponding Real PiayUsts. as 
shown In Fig.24A. This rule is observed even after the editing operation has come to a close, as shown in Fig.24B. 
99 Therefore, all Clips must be viewed by referencing one pf Real PlayLlsts. 

[0146] Referring to Flg.24C, the playback domaln.of the Virtual PlayList rnust be contained In the playback domain 
and In the Bridge-Clip playback domain. There must not be present In the disc Bridge-Clip not referenced by any Virtual 
PlayList. 
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[0147] The Real PlayUst, containing the list of the Playltem. must not contain SubPlayltem. Thef Virtual Play List 
contains the Playltenn list and, If the CPLtype contained in the PlayLlstQ is the EP_map type and the PlayLl8t_Jype is 
0 (PlayLlst containing video and audio) , the Virtual PlayLlst me^ contain one SubPlayitem. In the PlayLlstQ in the 
present enibodlnient, the SubPlayltem Is used only for audio post recording. The number of the SubPtay Items owned 
5 by one Virtual PlayLlst must be 0 or 1 . 

pi 48] The PlayLlst Is hereinafter explained. Fig^S shows the PlayList syntax which Is now explained. The 
verslon.number indicates four character letters Indicting the version numbers ot the PlayLlstQ, The verslon^n umber 
is encoded to "0045" in association with ISO 646. Length Is a 32-blt unsigned Integer Indicating the total number of 
byte of the PlayLlstQ a^ from directly after the length field to the trailing end of the PlayLlstQ. The PlayList_type, one 
10 example Qf which is ehown in Flg.26Js an 8-blt field Indicating the PlayLlst type. 

pi 49] The CPLtype Is one^blt flag Indicating the value of the CPLtype of the Clip referenced by the PlayltemQ and 
by the SubPlayltemQ. The CPLtypes defined in the CPIs of all Clips referenced by one PlayLlst must be of the same, 
values. The number_of_Play Items is a 16-blt field Indicating the number of Play Items present In the PlayList. 
[0150] The Playltem Jd corresponding to the preset PlayltemQ Is defined by the sequence In which the PlayltemQ 
15 appears In the for-toop containing the PlayltemQ. The Playltemjd begins with 0. The nlmber^oLSubPlayltems is a 
16-blt field indicating the nuit4>er of dubPlayitem in the PlayList. This value Is 0 or 1 . An additional audio stream path 
(audio stream path) is a sort of a sub path. 

(0151] The UlApplnfoPlayLlst of the PlayUst syntax shown in Flg.25 Is explained. The UlApplnfoPlayLlst stores 
I parameters of the user Interface application concerning the PlayUst, Flg,27 shows the syntax of the U lApplnfoPlayLlst, 

I 50 which Is now explained. The character^set Is an B-bit field indicating the method for encoding character letters encoded 
I In the PlayList name field. The encoding method conresponds to the values confomnlng to the table shown In Rg.19. 

\ pM 52] The name Jength Is ah 8-bit field indicating the byte length ol the PlayList name Indicated in the PlayList_name 

1 field. The PlayLlsLname field shows the appellation of the PlayLlst. The number of bytes of the number of the 

I namejength counted from left of the field Is the number of valid characters and indicates the PlayLlst appellation . The 

1 25 values next following these valid character letters may be any values. 

I [0163] The record_time_and Jate Is a 56-blt field storing the date and time on which the PlayLlst was recorded. This 

} field is 14 numerical figures for year/ month/ day/ hour/minute/ second encoded in binary coded decimal (BCD). For 

1 example, 2001/12/23:01:02:03 is encoded to "0x20011223010203". 

j roi54] The duration Is a 24-bit field indicating the total replay time of the PlayLlst In terms of hour/ minute/ second 

j 30 as a unit. This field Is six numerical figures encoded in binary coded decimal (BCD). For example. 01 :46:30 Is encoded 

to "0x014530". « « ^ . 

10155] The validj^erloci Is a 32-blt field indicating the valid time periocte of the PlayUst. This field Is 8 numerical 
figures encoded in 4-blt binary coded decimal (BCD). The valid j>erlod Is used In the recording and/or reproducing 
apparatus 1 e.g.. when the PlayUst, for which the valid period hais lapsed, Is to be automatically erased. For example, 
35 2001/06/07 is encoded to "0x200105or. 

[0156] The maker ID Is a ie-bit unsigned integer Indicating the maker of the DVR player (recording and/or repro- 
ducing apparatus 1 ) which has been the last to update Its PlayList. THe value encoded to makerJD is assigned to the 
licensor of the DVR format. The maker^code is a 16-blt unsigned Integer Indicating the model number of the DVR 
player which has been the last to update the PlayLlst. The value encoded to the maker^codo Is detenmined by the 
40 maker who has receh/ed the Ifcense of the DVR fonmat. 

[0157] If the flag of the playback_controLflag is set to 1 , Its PlayLlst Is reproduced only when the user successfully 
entered the PIN number. If this flag is set to O. the user may view the PlayLlst without the necessity of Inputting the 

PIN number. ^ ' ^ * *u 

i [015«J If the write^rotectjiag is set to 1 , the contents of the PlayLlst are not erased nor changed except the 

j 45 write protect Jag. If this flag is set to 0.. the user Is free to erase or change the PlayList. If this flag Is set to 1 , the 
j recording and/or reproducing apparatus 1 demonstrates a message requesting re-conf im^tlon by the user before the 

f user proceeds to erase, edit or overwrite the PlayLlst. 

pi 69] The Real PlayLlst, in which the write_protect_flag is set to 0, may exist, the Virtual PlayList, referencing the 
Clip of the Real PlayList may exist, and the writej)rot6cLflag of the Virtual PlayLlst may be set to 1 If the user Is 
so desirous to erase the Real PlayLlst, the recording and/or reproducing apparatus 1 issues an alarm to the user as to 
the presence of the af orementtened Virtual PlayLlst or "minimizes" the Real PlayLlst before erasing the Real PlayList. 
[0160] If Is^layedjlag Is set to 1 , as shown in Flg.28B, It indicates that the PlayList was reproduced at least onpe 
since it was recorded, whereas, If It Is set to 0. it indicates that the PlayLlst was not reproduced even once since It was 
recorded 

55 piei] Archive Is a two-bit field indicating whether the PlayList is an original or a copy, as shown In Flg.28C. The 
field of raf^thumbnalljndex Indicates the information of a thumbnail pteture representative of the PlayList If the 
ref Jhumbnailjndex field Is of a value other than OxFFFF. a thuntbnail ptelure representative of the PlayList Is added 
in the PlayLlst. with the PlayList being stored In the menu.thmb file. The picture Is referenced using the value of 
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ref JhumbnalUndex In the monu.thmb file. If the ref Jhumbnalljndex field Is OxFFFF, no thumbnail picture represent- 
ative of the PlayLlBt is added In the PlayList. 

[0162] The Playltem Is hereinafter explained, one Playltem() basically contains the following data: 
ClipJnformation.fHe^name for specifying the filename of the Clip. IN-tlme and OUT-tlme, paired together to specify 
5 the playbacic domaln^f Clip, STC.sequertceJd referenced by IN-tlme and OUT-tlme In case the CPLtype defined In 
PlayLlstO Is EP.map type, and Connection_Condnion IndlcaUng the connection condition of previous Playltem and 
current Playltem. 

[0163] If PlayList is made up of two or more Playltems, these Play Items are arrayed In a row, without temporal gap 
or overiap, on the global time axis of the PlayUst. If CPLtype defined In the PlayList Is EP_nr>ap type and the current 

10 PlayList does not have the BrldgeSequence(). the IIM-tlme and OUT-tlnne pair must Indicate the same time on the STC 
continuous domain as that specified by the STC^sequenco Jd. Such Instance Is shown In Flg.29. 
[01641 Plg-30 shows such a case in which the CPLtypo defined by PlayLlst() and, If the current Playltem has the 
BrldgeSequenceO. the rules as now explained are applied. The IN_time of the Playltem previous to the current Play- 
ltem, shown as IN Jlme1 , Indicates the time In Bridge-Clip specified In the BridgsSequencelnfoO of the current Play- 

t5 Item. This OUTjlme must obey the encoding limitations which will be explained subsequently. 

[0165] The IN_tlme of the current Playltem, shown as IN_tlme2, Indicates the time in Bridge-Cllp specified In the 
BridgeSequencelnfoO of the current Playltem. This IN.tlmo also must obey the encoding limitations as later explained. 
The OUTJIme of Playltem of the current Playltem, shown as 0UT_tlnr»2. Indicates the time on the STC oontinuous 
domain specified by STC^sequenbceJd of the current Playltem. 

^ [0166] If the CPLtype of PlayLlstO Is TU^map type, the IN^tlme and OUTJIme of Playltem. paired together. Indicate 
the time on the same Clio AV stream, as shown In Flg.31 . ^ , ... 

[0167] The Playltem syntax Is as shown In FI9.32. As to the syntax of the Playltem. shown In Flg.32. the field of the 
Clip Jnf ormation^fite^name Indicates the filename of the Clip Inf onnatlon. The CHp^stream_type defined by the Cliplnfo 
0 oflhls Clip information file must Indteato the Clip AV stream. 

25 [0168] The STC^sequence Id is an 8-blt fleW and Indicates the STC.sequenceJd of the continuous STC domain 
referenced by the Playltem. If the CPLtype specified In the PlayLlstO Is TU^map type, this 8-blt field has no nrteaning 
and is set to 0. IN .time is a 32-blt field and used to store the playback start time of Playltem. The semantics of IN^tlme 
differs with CPLtype defined In the P!ayLlsl(). as shown In Flg.33. , ^, rr 

[01691 OUTJIme Is a 32-blt field and is used to store the playback end time of Playltem. The semanttes of OUTJIme 

so dlffere with CPLtype defined In the PlayLlstO. as shown In Flg.34. 

[0170] Connection^condition is a 2-blt fiekl Indicating the connectk>n condition between the previous Playltem and 
the current Playltem, as shown In Fig.35. Flgs.36A to 36D Illustrate various states of Connection.condlilon shown In 

roirn BrtdgeSequencelnfo Is explained with reference to Flg.37. This BrIdgeSequencelnfo Is the ancillary Informa- 
S5 lion ot the cun-ent Playltem and Includes the following Information. That Is, BrIdgeSequencelnfo Includes 
Brldge.ClipJnfomiatlonJIIe^name for specifying the Brldge^Cllp AV file and a Bridge_Cllp,lnformatlon Jlle.name 
specifying the conrespondlng Clip Inforn^tion file (Flg.4^^^ 

[0172] It Is also an address of a source packet on the Clip AV stream referenced by the previous Playltem. Next to 
this source packet Is connected the flnit source packet of the Bridge-Clip AV stream. This address is termed the 

40 RSPN^exIt fromjjrevious^Cllp. It Is also an address of the souice packet on the Clip AV stream referenced by the 
current Playltem. Ahead of this source packet Is connected the last source packet of the Bridge.cllp AV stream file. 
This address is termed RSPN_enterJo.cun^ent_Cllp. ^ „ r^u aw 

[0173] In Fig 37. RSPN_arr1valJlme_dl8ConUnulty Indicates an address of a source packet In the Brldge.Cllp AV 
stream where there is a discx>ntlnuous point In the arrival time base. This address Is defined In the CHplnfoO (Flg.46). 

45 [0174] Fig 38 shows the syntax of the BridgeSequencelnfo. Tuming to the syntax of BrIdgeSequencelnfo shown In 
Fig 38 the fiekl of Bridge Clip Jnformatlon Jlle.name Indkates the fllename of the Clip Inf onnatlon file corresponding 
to the Brldge_Cllp_lnforTnation_flle. The CHp_stieam„type defined In CHplnfoO of this COp Intomiatlon file must Indksate 
•Bridge.CllpAV stream'. ^ * *w aw 

[0178] The 32-blt field of the RSPN^exlLfromj)revlous.Cllp is a relative address of a source packet on the Clip AV 

so stream referenced by the prevk>u8 pTayltem. Next to this source packet Is connected the first source packet of the 
Brtdge.CIlp AV stream file. The RSPN^exIt JronrLPWVIous.Cilp has a size based on the source packet number as a 
unit, and is counted with the value of the offset.SPN defined In the CHplnfoO from the first source packet of the Clip 
AV stream file referenced by the previous Play Item. 

[0176] The 32-blt field of RSPN_enterjo.curent„Cllp Is the relative address of the source packet on the CHp AV 
55 stream referenced by the current Playltem. Ahead of this source packet Is connected the last source packet of the 
Bridge Clip AV stream file. The RSPN_enterJo_curent_Cllp has a size that is based on the source packet number 
as a unit. The RSPN_enterJo_curent.Cllp Is counted with the value of the offset.SPN, defined In the CHplnfoO from 
the first source packet of the Clip AV stream file referenced by the cunrent Playltem, as an Initial value. 
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[01771 . The SubPlayltem Is explained with reference to Rg.39; The use of SubPlayltemQ is permitted only If the 
CPLtype of the PlayUst() Is the EP_map type. In the present embodiment. SubPlayltem Is used onty for audio post 
recording. The SubPlayltem() includes the following data. First, ft Includes Qlipjnfomhationjile.name for specifying 
the Clip referenced by the sub path in the PlayList 
j 5 [0178] It also Includes SubPath_irsl_tlme and SubPath_OUT_tlme for specifying the sub path playbacl< domain In 
I the Clip. Additionally, It Includes sync_Playltem_td and start_PTS_oLPIayltem lor specifying the time of starting the 

I " sub path reproduction on the main path time axis. The Clip AV strearri, referenced by the sub path, must not contain 
\ ' STC discontinuous points (discontinuous points of the system time base) . The cloclcs of audio samples of the Clip used 

I In the sub path are loclced to the cloclcs of the audio samples of the main path. 

10 . [OI79) Rg.40 shows the syntax of the SubPlayitem. Turning to the syntax of the SubPlayltem, shown in Fig.40, the 
I field of the Clip Jnformatlon_file_name indicates the filename of the Clip Information file and Is used by a sub path in 

1 the PlayList. The Cllp^stream.type defined In this CflplnfoQ must Indicate the Clip AV stream. 

I .. [0180] An 8-blt field of sync.P lay Item Jd Indicates the sub path typo. Here, only '0x00' Is sot, as shown In Flg,41 , 
I while other values are reserved for. future use. 

I 15 [0181] The 8->blt field of sync^PlayllemJd indicates the Playltem Jd of the Playltem containing the time of playbacic 
i start of the sub path on the time axis of the main path. The value of Playltem Jd corresponding to the. preset Playltem 

|. Is defined In the PlaylJ8tO(Fig.25). 

I [01 82] A 32-blt field of sync_start_PTS_or Playltem denotes the time of playbacic start pf the sub. path on the time 

I axis of the main path, and denotes the upper 32 bits of the PTS (presentation time stamp) on the Playltem referenced 

I 20 by the sync_Playltem_ld. The upper 32 bit field of the S ub Pathol Njime stores the playback start time of the sub path . 
1 SubPath JN^time denotes upper 32 bits of the PTS of 33 bits corresponding to the first presentation unit in the sub path . 

I [01 83] The upper 32 bit field of subPath.OUTJime stores the playbacic end time of the sub path . SubPath_OUT_tlme 

\ indicates upper 32 bits of the value of the Presentation^end^TS calculated by the following equation: 



Pre8ent8ition.end_TS = PTS_dUT + AU_duratlon 



I S5 

i ' ' 

i " ..... . • 

\ where PTS_out Is the PTS of the 33 bit length corresponding to the last presentation unit of the SubPath and 

I AU.durationlsthe.90l<Hzbaseddisplayperlodof the last presentation unit of the SubPath. 

I 30 [0184] Next, PlayUstMarkQ in the syntax of xxxxx.rpis and yyyyy vple shown in Flg.23 is explained. The mark infor- 
mation pertinent to the PlayList Is stored in this PlayUstMaik. Fig.42 stiows the syntax of PlayListMark. Turning to the 

I syntax of the PlayListMark shown In Fig.42, version_number is four charaicter letters Indicating the version number of 

. i this PlayLlstMartcQ. The ver8lon_number must be encoded to "0045" In accordance with ISO 646. 

i [0185] Length Is an unsigned 32-blt Integer Indicating the number of bytes of PlayLlstiV^ark() from directly after the 

I 35 length field to the trailing end of the Play UstMarkQ. the number_of_PlayLlstMarks is a 1 6-blt unsigned Integer indicating 

i the number of marks stored in the PlayListMark. The number.of^PlayLlstMarks may be zero. The mark.type is an 

1 8-blt field indicating the mark type and is encoded In the table shown in Flg.43. 

I [0188] A 32-blt filed of marictime_stamp stores a time stamp indfcating the polrit spetclfied. by the mark. The seman- 

1 ttes of the mark_time_8tamp differ with CPI_type defined in the PlayList(), as shown in Rg.44. The Playltemjd is an 

I 40 8-blt field specifying the F^ayltem where the mark is put. The values of Playltemjd corresponding to a preset Playltem 

5 Is defined In the PlayUstO (see Fig.25), 

.| [0187] An 8-blt field of character_set shows the encoding rnethod of character letters encoded in the iTiark_name 

1 field. The encoding method corresponds to values shown In Fig.1 9. The 8-bit field of nanriejength indtoates the byte 

I length of the mark name shown in the mark_name field. The mark_nanle field denotes the mark riame indicated \n the 

\ 45_ mark_name field. The number of bytes corresponding to the number of namejer^hs from left of this field is the 
effective character letters and denotes the mark name. In the mark_nanhe field, the value next following these effective 

\ character letters may be arbitrary. 

1 [0188] . The fli^id of the refjhumbnailjndex denotes the information of the thumbnail picture added to the mark. If 

I Jhe field of the refJhumbnaiUndex is not OxFFFF, a thumbnail picture is added to Its mark, with the thumbnail picture 

I so being stored in the nriark.thmb file. This pteture Is referenced In the mark:thmb file, using the value of 

|. rBf_thumbnailJndex, as explained subsequently, if the ref_thumbnall Jndex field Is OxFFFF. It Indicates that no thumb- 

i nail picture Is added to the mark. 

\ [0189] The Clip Information file is now explained. The zzzzz.clpl (Clip Infonnation file) is made up of six objects, as 

I shown In Fig.45. These are Cliplnfo(), STC_lnfp(), ProgramQ, CPI(). C^jMarkQ and MakersPrlvateData(). For the AV 

i 55 stream (Clip AV .stream or Bridjge^Cllp AV stream) and the corresponding Clip Infomnatlon file, the same string of nu- 

i morals "zzzzz" is used. . 

} [0190]" Turning to the syntax qI zzzzz.clpi (Clip Information file) shown in Fig.45 is explained. The 

I Ciiplnfo_Start.addre8S Indicates the leading end address of Ciiplnfo() with the relative number of bytes from the leading 
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end byte of the zzzzz.cipi file as a unit. The relative number of bytes Is counted from zero. 

[0191) The STC_lnfo_Start_addres6 Indicates the leading end address of STC^lnfo with the relative number of bytes 
from the leading end byte of the zzzzz.cipi file as a unit. The Programlnto^Start.address indicates the leading end 
address of ProgramlnfoO with the relative number of bytes from the leading end byte of the zzzzz.cipi file as a unit. 

9 The relative number of bytes Is.counted from 0. The CPLStart.address indicates the leading end address of CPiQ 
with the relative number of bytes from the leading end byte of the zzzzz.cipi file as a unit. The relative number of bytes 
is counted from zero. 

. [01 92] The ClipMarK_Start.addre88 Indicates the leading end address of CllpMark() with the relative number of bytes 
from the leading end byte of the zzzzz.cipi file as a unit. The relative number of bytes is counted from zero. 

10 The.MakersPrivateData Start.addres6 indicates the leading end address of MakersPrivateData() with the . relative 
number of bytes from the leading end byte of the zzzzz.cipi file as a unit The relative number of bytes is counted from 
zero. The padding^word Is Inserted In acoordanoe with the syntax of the zzzzz.clpi file. N1 , N2, N3, N4 and N6 must 
be zero or optional positive Integere. The respective padding words may also £»8ume optional values. 

[0193] The Cliplnfo Is now explained. Fig.46 shows the syntax of Cllplnfo. Ftg.46 shows the syntax of Cliplnfo. in 
15 the CliplnfoO is stored the attribute InfomriBtloh of corresponding AV stream files (Clip AV stream or Bridge-Clip AV 
stream file). 

[0194] Turning to the syntax of the Cliplnfo shown in Fig.46, verslon.h umber is the four character letters Indicating 
the version number of this CliplnfoO* The verslon.number must be encoded to "0045" In accordance with the ISO 646. 
Length Is a 32-blt unsigned integer indicating the number of bytes of CllpinfoQ from directly at back of the length field 
20 to the trailing end of the CliplnfoO. An 8-blt field of Cilp_stream_type Indicates the type of the AV stream corresponding 
to the Clip information fDe, as shown in Flg.47. The stream types of the respective AV streams will be explained sub- 
sequently. 

[0195] The 32-bit field of offset^SPN gives an offset value of the source packet number of the first source packet 
number of the first source packet of the AV stream (Clip AV stream or the Bridge-Clip AV stream). When the AV stream 

25 file is first recorded on the disc, this offset^SPN must be zero. 

[0196] Referring to Flg.48, when the beginning portion of the AV strearin file is erased by editing, offset_SPN may 
assume a value other than 0. In the present embodiment, the relath/e source packet number (relath/e address) refer- 
encing the offset.SPN Is frequently described In. the fonn of RSPNxxx, where xxx is modified such that RSPN^xxx is 
RAPN_EP_start. The relative source packet number Is sized with the source packet number as a unit and Is counted 

50 from the first source packet number of the AV stream file with the value of the offset^SPN as the initial value. 

[01 97] The number oif sou rce packets from the first source packet of the AV stream file to the source packet referenced 
by the relative source packet number (SPN^xxx) Is calculated by the following equation: 

SPN.xxx = RSPN^xxx . offset.SPN. 

33 

Flg.4a shows an Instance In whteh offset^SPN is 4. 

[0193] TS_rocordlng_rato is a 24-bll unsigned Integer, which affords an Input/output bit rate required for the AV 
stream to the DVR drive (write unit 22) or from the DVR drive (readout, unit 28). The record_tlme_and_date is a 56-blt 
40 field for storing the date and time of recording of the AV stream corresponding to the Clip and is an encoded represen- 
tation of year/month/day/hour/minute In 4-blt binary coded declhrial (BCD) for 14 numiarlcal figures. For example, 
2001/2/23:01 :02:03 Is encoded to •0x20011223010203". 

[0199] The duration Is a.24-bit field Indteating the total playback time of the Clip by hour/minute/second baaed on 
arrival time clocks. This field is six numerical figures encoded in 4-blt binary coded decimal (BCD). For example, 01 : 
45 45:30 is encoded to "0x01 4630'. 

[0200] A flag tlme_controlled_flag indicates the recording mode of an AV stream file. If this tlme.controlled_flag \& 
1 . it Indicates that the recording mode Is such a mode In which the file size Is proporiionate to the time elapsed since 
recording, such that the condition shown by the following equation: 

^ T8_average_rale*1 92/1 86*(t- start Jme)- a <=8lze_cllp(l) 

<= TS_average_rate*1B2/1 B8*{l - startjtinne) + a 

55 where TS_average_rate is an average bit rate of the transport stream of the AV stream file expressed by bytes/second. 
[0201] In the above equatton, t denotes the time In seconds, while startjlme Is the time point when the first source 
packet of the AV stream file was recorded. The size_cHp(t) Is 10*1 92. bytes and o Is a constarit dependent on 
TS_average_rate. 
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[0202] . If time.controllecijnag |8 set to p, it Indicates that the recording mode Is not controiling so that the time lapse 
of recording Is proportionate to the f i to size of. the AV stream. For example, the input trBnsport stream is rcicorded in a 
transparent fashion. 

[0203] ' if time.controiled^fiag is set to 1 , the 24-bit field of TS:.average^rate indicates the value of TS.average.rate 
^ used In the above equation, if time_control]ed_flag is set to 0, this field has no meaning arid rnust be set to 0. For 
example/the variable bit rate trjansport stream is encoded by the following sequence: First, the transport raite is set to 
the value of TS_recording.rate. The video stream is encoded with a variable bit rate. The transport packet is intermit- 
tently encoded by not employing null packets. 

[0204] The 32-blt field of RSPN_arrivaLtime_dlscontlnuity Is a relative address of a site where arrival timebase 
, w discohttnuities are produced on the Bridge^dip AV stream file, the RSPN^ariival jtkne.dlsoontinuity Is sized with the . 
source packet number. as a unit and is counted with the value of offset^SPN defined in the Ciipinfo() as from the.first 
source packet of the Bridge-Clip AV strearn file. An absolute address in the Brklge-Ciip AV stream file Is calculated 
based on the afprementiohed equation:. 

SPN.xxx=RSPN.xxx-offset;.SPN, 

[02051 The 144-bit field of reserverjor^system.use is reserved for a s^tem. If is.formatjdentifierjraild flag is 1 , 
It Indlciates that the field of fbnriatjdentlfler Is effisctlve* If l84ormat_ldentifler:.valid flag is 1» it Indicates that the 

20 formatjdentmer field Is valid, if is_originaLrietworkJp_varid flag is 1, it ihcBcates that the field of 
ls_tran8p6rl_streamJD-v0lid Is valid. If the flag is_transport_stre€imJD-valid is 1, it indicates that the 
. transpon^streamJD field is valid. If Is^serveceJD.valld flag is 1 , It indteates that the sewece^lO field Is valid. 
[0206] if Is.country codejvaild flag Is 1, It indicates that the field country^code is valid The 32-bit field of 
format Jdentlfier indk^ates the value of f omnaU ttentlf ler owned by a registrieitlon/descrlptor (defined in ISO/IECi 381 8-1 ) 

25 in the transport stream. The 16-blt field of originaLnetworK-ID Indicates the value of the origlnal_networkJD defined 
In the transport stream. 

[0207] The .16-bit field in servece_ID denotes the value of serveceJD defined In the transport strearn. The 24-bit 
field of country^code shows a country code defined by 1S03166. Each character code Is encoded by IS08859-1. For 
example, Japan is represented as "JPN" and Is encoded to ''Px4A 0x50 0x4E". The stream JorniaLname is 1 5 character 
30 codes of ISO-646 showing the name of a fomtat organization affording strearr) definitions of transport streams. .^ 
invalid byte In this field has a value of •OxFF. 

[0208] Fomiatjderitirier, origlnaLnetworK^lD, transport_stream_lD, senfeceJD, country.code and 
stream_lformat_r\ame Indicate servtee providers of transport streams. This allows to recognize encoding limitations on 
audio or video sfreanis and stream definitions of private data streams other than audio video streams or SI (service 

a5 infonnation). These lnfonTiatk)n can l^e used to check if the decoder is able to decode the stream. If such decoding Is 
posslbie,.the information may be used to initialize the decoder.system before starting the decoding. 
. [0209] STCJnfo is.npw explained, f helirnei domain in the MP EQ-2 transport strearin not containing STC discontin- 
uous pplnt8(dlscontlnuou8 points of the syetem time base) \a temned the STC_aequence. In the Clip, STC_sequence 
is specified by the value of STC^sequenceJd. Figs.SOA and SOB Illustrate a continuous STC domain. The sanfie STC 
. ■ ^ values never appear Iri the same STC_sequence, although the maxlrnum tine length of Clip is limited, as explained 
subsequently. Therefore, the same PTS values also never appear in the same STC_sequence. if the AV stream contains 
N STC dtecontlriupus points, where N > 0, the Clip eystenri time base is split into (N+l ) STC.sequences. 
[0210] ' STC_lnfb stores the address of the sits where STC discontinuities (system timebase discontinuities) are pro- 
duced. As explained with reference to Fig.51 , the RSPN.STC.start indicates the address and begins at a time point 

45 of arrival of the source packet referenced by the (k+1)st RSPiM_StC_8tart and ends at a time point of anivai of the 
last source packet. 

[0211] Fig,52 shows the syntax of the STC.Info. Turning to the syntax of STCJnfo shown iri Flg.62, verslon^number 
is four character letters Indteating the version number of STC JnfoQ. The versloh_number must be encoded to "0046'* 
In accordance with ISO 646. 

so . [0212] Length is a 32-blt unsigned Integer Indicating the number 6f bytes of STCJnfoQ from directly after this length 
fleW to the end of STCJnfo. If CPLtypeof CPI() ir>dlcates TU_map type, 0 may be set in this length field. If CPLtype 
of CPIO Indicates EP_map type, the num_of_STC_s^uerice mut be of a value not less than' 1 . 
[0213] Ah.8-btt unslgrred Integer of num_of_STC_sequence indicates the number of eiequences in the Clip*. This 
value Indicates the number of the for-loops next following the field. The stc_sequencejd conresponding to the preset 
ss .. STC^sequence is deffeied by the order in whteh appears the RSPN_STC_start conresponding to the STC^sequence 
- In the for-loop containing the RSPN_STC_start. The 8TC_sequenceJd commerices at 0. 

[021 4] . The 32-blt field, of RSPN.STC.start Iridteates an address at which the STC^sequerxje commerices oh the 
AV stream file. RSPN:.STC_start denotes an address where system time base discontinuities are produced In the AV 



19 



EP1 198 133 A1 

stream file. The RSPN.STC.start rtiay also be a relative address of the source packet having the first PCR of the new 
system time base in the AV stream. The RSPN_STC_8tait Is of a size based on the source paclcet number and Is 
counted from the flrat source packet of the AV stream file with the cffset.SPN value defined In Cllpinfo() as an Initial 
value. In this AV stream filei the absolute address Is catoulated by the above-mentioned equation, that Is 

5 

SPN^xxx » RSPra^xxx - off8et_SPN. 

[0215] Programlnfo In the syntax of zzzz.ciip shown In Fig,46 is now explained with reference to Fig.63. The time 
10 domain having the follovying features in the Clip Is tenned program^sequence. These feature are that the value of 

PCR^PIO Is not changed! the number of audio elementary streams Is also not changed, the PID values in the respective 

vldeo'streams are not changed, the encoding Information which Is defined by VIdeoCodlnglhfo thereof ie not changed; 

the number of audio elementary streams Is also not changed, the PID values of the respecthfe audio strean^s are not 

changed, and that the encoding information^ which is defined by AudloCodlnglnfo thereof, is not changed. 
IS [0216] Progr€wn_8equence has only one system time base at the same time point. Program.sequence has a sole 

PMT at the same time point. Programihfo() stores the address of the site where the program^sequehco commences. 

RSPNj3rogram_8equence-fitart Indteates the address. 

[0217] Fig.54 Illustrates the syntax of Programlnfo. Turning to the Programlnfo shown In. Flg.64, version^n umber Is 
four character letters indteating the version number of Programinfo(). The version^number must be encoded to "0045" 

so in accordance with ISO 646. 

[0218] Length Is a 32-blt unsigned Integer indicating the number of bytes of ProgramlnfoO from directly at back of 
this length field to the end of program(lnfo(). If CPLtype of CPI() Indicates the TU^map type, this length field may be 
set to 0. Jf the CPLtype of CPIQ Indteates EP^map type, the number_of_programs must be of a value not less than 1 . 
[0219] An 8-blt unsigned Integer of number_of_program.8equences denotes the number of program^sequences In 

25 the Clip. This value Indteates the number of for-loops next foltowing this field. If program^eequence In the Clip Is not 
changed, 1 rnust be set In the number of program^sequences. A 32-bit fleW of RSPNj?rogranrusequence_8tart is a 
relative address where the program sequence commenced pn the AV stream. 

[0220] RSPNj3rogram_sequence_start Is sized with the source packet number as a unit and Is counted with the 
. value of offseUSPN defined In the ciiplnfo() as from the first source packet of the AV. stream file. An absolute address 
30 in the AV stream file Is calculated by: 

SPN_xxx = RSPN.xxx - offset^SPN. 

33 The values of RSPN^rogram^sequence^start In the f or-ioop syntax must appear In the rising order. 

[0221] A 1 6-blt field of PCR.PID denotes the PID of the transport packet containing an effective PCR field effective 
for the prograrTu«©quonce. "An 8-blt field of number^of^audlos Indteates the number of for-loops containing 
audio stream^PIDahd AudloCodlnglnfoO. A 16-bit field of vldeo^stream^PID indicates the PID of the transport packet 
containing a video stream effective for Its program.eequence. VldeoCodlnglnfoO, nextfoliowlngthleflekl, must explain 

40 the contents of the video stream referenced by Its vldeo_stream„PiD. 

[0222] A 1 6-bit field of audio_.8tream.PiD indteates the PID of a transport packet containing the au?«p stream effective 
for Its program sequence. The AudioCodlnglnfo(). next foltowing this field, must explain the contents of the video stream 
referenced by Its audlo_stream_PID. 

[0223] The order in which the values of vldeo.stream^PID In thefpr^oop of the syntax must be equal to the sequence 
45 of PID encoding of the video streon In the PMT effective for the prograrrusequence. Additionally, the order In whteh 
the values of audlo_stream_PID appears In the for-loop of the syntax must be equal to the sequence of PID encoding 
of the audio stream in the PMT effective for the program^sequence. 

[0224] Flg.55 shows the syntax of VldeoCbdlnginfo in the syntax of the Programlnfo shown In Flg,64. Turning to the 
syntax of the VIdeoCoding info shown in Rg.55, an 8-blt field of video Jormat indteates the video fonnat corresponding 
50 to video.stream PID In ProgramlnfoO, as shown In Flg.56. 

[0225] Referring to Flg.57. an B-blt field of frame^rate indicates the video frame rate corresponding .to the 
vldeo.stream^PID In Programlnfo(). An 8-bit field of dlspIay:.aspect„ra«o Indicates a video dlsptey aspect ratio corre- 
sponding to vldeo_stream_PID In ProgramlnfoO. 

[0226] Flg.59 shows the syntax of AudloCodlnglnfo In the syntax of Programlnfo shown In Flg.54. Turning to the 
55 syntax of the AudioCodlng Info shown in Flg.59, an 8-bit field of audio Jomnat Indicates the audio encoding method 
corresponding to audlo_8trearn_PID in ProgramlnfoO, as shown In Flg,60. 

[0227] An 8-bit field of audio componenUiype Indteates an audio component type corresponding to 
audio stream_PID In ProgramlnfoO as ehown In FIg.ei , whilst an 8-blt field of eampllng^f requoncy Indicates an audio 
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sampling frequency corr^pondlng to audlo_8tream_PID in Programlnfo() as shown in Flg.82. 
[0228] The CPI (Characteristics Point lnf(Jrmatlon) In the syntax of zzzzz-dip shown In Flg.45 Is explained. The CP! 
• Is usedforcorrelatlnjgthotlme Information In the AV stream with the address In Its file. The CPI Is of two types, namely 
EP^map andTU^map. In Ft9.63, Jf CPLtype In CPI() Is EP^map. Its CPIO contains EP_nr^. In Flg.64, If CPI_type In 
5 CPK) Is TU_map. Its CPIQ contains TU_map. One AV stream has one EP_map or one TU^me^. If the AV stream Is 
an SESF transport stream, the conrespondlng Clip must own an EP_map. 

[0229] Fig.65 show the syntax of CPI. Turning lo Ihe syntax of CPI shown In Flg.65, the verslpn^number Is four 
character letters Indicating the version number of this CPI(). The verslon^number mujst be encoded to "0046" in ac- 
cordance with ISO 646/Length Is a 32-blt unsigned Integer Indicating the number of bytes as from directly after this 
10 length field to the trailing end of the CPIQ. The CPI^type Is a 1 -bit flag and Indicates the CPI type of Clip, as shown In 
Rg.66.. 

[0230] The EP^map In the CPI syntax shown In Flg.65 Is explained. There are two types of the EP_map, that is 
EP_map for a video stream and an EP_map for an audio stream. The EP_map_type In the EP_map dlfferentlatee 
between these EP_map types. It the Clip contains one or more video streams, the EP_map for the video stream must 
15 . t>e used. If the Clip does not contain a video stream but conjalns one or more audio streams, the EP_map for the audio 
stream must be used. 

[0231) The EP_map for a video stream Is explained with reference to Flg.67. The EP_map for the video stream has 
data stream^PID. PTS.EP^start and RSPN^EP^start. The stream^PID shows the PID of the transport packet trans- 
mitting a video stream. The PTS_EP_etart Indicates the PTS of an access unit be^nnlng from the sequence header. 
20 of the video stream. The RSPN_RP_start Indicates the address of a source packet Including the first byte of the access 
unit referenced by the PTS^EP^start In the AV stream. 

[0232] A sub table, termed EP jnap Jor_one_stream.PID() Is created from one video stream transmitted by the 
transport packet having the same PID to another. If plural video streams exist In the Clip, the EP^nrtap may contain 
plural EP map_for_one_stream^PIDO. 
25 [0233J The EP_map for audio stream has data stream^PID, PTS_EP_8tart and RSPN^EP^slart. The stream.PID 
shows a PID of a transport packet transnriltting an aiidio stream. The PTS^EP^start shows the PTS of an accessing 
ufilt In the audio stream. The RSPN.EP-start Indicates an address of a soun:e packet containing a first byte of the 
access unit referenced by PTS_EP_start of the AV stream. 

(02341 The siA) table termed EP.mapJor_onejBtream_PID() Is created from one audio stream transmitted by the 
30 transport packet having the same PID to another, if there exist plural audio streams ^n the Clip, EP^map may contain 
. plural EP map- Jor^one stream_PID(). 

[0230] Turning to the relatton between EP.map and STC.Info, one EP«map_for_one_stream_PIDO is created In 
one table In-espectlve of discontinuous points In the STC. Comparison of the value of the RSPN:^EP_start to the value 
' of RSPN STC start defined In STCJnfoQ reveals the boundary of data of EP.map belonging to respective 
55 STC^sequences (see Flg.68). The EP^map must have one EP^map^for^one^stream^PID for a continuous stream 
range transmitted by the same PID. In the case shown In Flg.OS. program#1 and program#3 have the same video PID. 
however, the data range Is not continuous, so that EP_mapJor_one>tream_PID must be provided for each program. 
(0236) Rg.70 shows the E P_map syntax. By way of explanation of the EP^map syntax Shown in Fig.70, the EP.lype 
V is a 4-blt field and shows the EP^nwp entry point type, as shown In Flg.71 . The EP_type shows the semantics of the 
40 data field next following this field. If Clip Includes one or more vWeo stream, the EP^iype must be set to 0 (VWeo'). 
Allemanvely, If the Clip contains no video stream but Contains one or more audio stream, then EP__type must be set 
to 1 ('audto'). 

(02371 The le^bit field of number_of_8tream.PIDs Indteates the number of tinges of loops of the for-loop having 
number^of^stream^PIDs in the EP^mapQ as a variable. The 16-blt field of stream„PID(k) Indksates the PID of the 
45 transpoil packet transmitting the number k elementary stream (video or audio stream) referenced by 
EP^mapJor.one.stream^PID (num_EP_entries(k)). If EP^type is 0 (Video*). Its elementary stream must be a video 
stream. If EPltype Is equal to 1 ('audio'), Its elementary stream must be the audio stream. 

P238] The 16-blt fleW of num_EP_entries(kj Indicates the num_EP_entries(k) referenced by EP_map_entrte8(k)). 
The EP_map for_one_stream.PID_ Start_address(k): This 32-blt field Indicates the relative address position at whteh 
so the EP^map Jor_one_streanuPID(num_EP_entries(k)) begins in the EP_map(). This value Is Indteated by the size as 
from the first byte of the EP^mapt). 

[0239] Paddlng^word must be Inserted In accordance with the EP.mapO syntax. X and Y must be optional positive- 
Integers. The respective padding words may assume any optional values. 

[0240] Rg.72 shows the syntax of EP_map_for_one_stream_PID, By way of explanation of the. syntax of the 
55 EP^mapJor one.stream^PID shown In Fig.72, the semantics of the 32-bll field of PTS^EP.start differs with the 
EP*"type defined by EP.map(). if EP.lype is equal to 0 ('video"), this field has upper 32 bits of the 33-blt precision PTS 
of the access unit beginning with a sequence header of the video stream, if the EP.type Is equal to 1 ('audto'), this 
flew has upper 32 bits of PTS of 33 bit precision of the,acce88 unit of the audio stream. 
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. [0241] The semantics of the 32-blt field of RSPN_EP_8tart differs with the EP.type defined in EP_nnap{). If EP^type 
is equal to 0 (Video'), this field Indicates the relative address of the source packet Including the first byte of the sequence 
. header of the access unit referenced by the PTS_EP_start In the AV stream. Alternatively, If EP.type Is equal to 1 
('audio'), this field indicates the relative address of the source paclcet containing the firat byte In the audio stream of 
9 the access unit referenced by the PTS.EP.start In the AV stream. 

[0242] RSPN_EP_8tart is of a size which is based on the source packet number as a unit, and is counted from the 
first source packet of the AV stream file, with the value of the offset_SPN, defined in Cilpinfo(), as an initial value. The 
absolute address In the AV stream file Is calculated by 

SPN_xxx=RSPN_xxx-offset^SPN. 

[0249] It is noted that the value of the RSPN_EP_start In the syntax must appear In the rising order. 
[0244] The TU_map is now explained with reference to Flg.73. TU_map \oms a time axis based on the source 
15 packet arrival time clock (timepiece of the arrive time base). Thl^ time axis Is temped TU_map_time_axl8. The point of 
origin of TLI_map_time_axl8 Is Indteated by offset^tlme In theTU_map(). TU_map.tlme.axis is divided In a preset iinlt 
as from offset.tlme, this unit being tenmed time.unlt. 

[0245] In each time.unit in the AV stream, addresses on the AV stream file of the source pecket In the first complete 
fomn are stored In TU^map. These addresses are temied RSPN_t(me_unlt„8tart. The time at which begins the k{k a 
20 o)th time.unit on the TU.mapJime^axis is termed TU_startjime(k). This value is calculated based on the foitowing 
equation: 

TU_start_tlme(k) = offset_tlme + k*tlme_unlt_slze. 

25 

[0246] It is noted that TU_startJime(k) has a precision of 45 kHz. 

[0247] Fig.74 shows the syntax of TU_map. By way of explanation of the TU_map syntax shown In Flg.74. the 32-blt 
field of offset.tlme gives an offset time relative to TU„map_tlme_axls. This value Indteates the offset time relative to 
the first time_unlt In the Clip. The offseLtlme Is of a size based on 45 kHz clock derived from the 27 MHz precision 
30 arrival tinr>e ck>cks as unit. If the AV stream Is to be recorded as new Clip, offset^time must be set to 0. 

[0248] The 32-bit field of time.untt.size affords the size of the ttme.unit, and is based on 45 kHz clocks, derived 
from the 27 MHz preci8k>n arrival time clocks, as unit. Preferably, time.unnLsize is not k>nger than one second 
(tlme.unlt^size s 45000). The 32 bit fleW of nunr*er_ol.time.unll_entiles Indicates the number of entries stored In 
TU_map(). 

35 [0249] The 32-bit field of RSNJIme_unlt_8tarl Indteates the relative address of a site In the AV stream at which 
begins each tlme^unlt. RSN.time.unlt^start is of a size based on the source packet number as unit and Is counted 
with the value of offset^SPN defined In Cliplnfo() as from the first source packet of the AV stream file as an initial value. 
The absolute address in the AV stream file is calculated by 

^ SPN_xxx=RSPN_xxx-off8et^SPN. 

[02B0] It is noted that the value of RSN_tlme„unlt_8tart In the for-loop of the syntax must appear in the rising order. 
If there Is no source packet in the number (k-i-1) time.unit, the number (k-i-l) RSISl.tlme.unlt.start must be equal to 
45 the number k RSPN^timeLunit^start. 

[02B1] By way of explanation of the CUpMerk in the syntax of zzzzz.cl|p shown in Fig.45. the ClipMark Is the. mark 
Infomiation pertinent to clip and Is stored in the CIlpMark. This mark Is not set by a user, but la set by a recorder 
(recording and/or reproducing apparatus 1 ). 

[0252] Flg.75 shows the CIlpMark syntax. By way of explanatksn of the CiipMark syntax shown in Rg.75, the 
so version.number is four character letters Indicating the version number of this CiipMark. The version_number must be 
encoded in accordance with ISO 646 to "0045". 

[0253] Length is a 32-blt unsigned Integer indteating the number of bytes of the CllpMark() as from directly after the 
length field to the trailing end of ClipMarkQ. The number.of_Cllp_marks is a 16-bit unsigned integer Indicating the 
number of marks stored in CiipMark and may be equal to 0. Mark.type Is an 8-bit field indicating the mark type end Is 
55 encoded In accordance with the table shown In Flg.70. 

[0254] 'Mark_time.stamp Is a 32'blt fieki and stores the tlnte stamp Indicating a pointer having a specified mark. The 
selnanttes of marK-tlme.stamp differs with CPLtype In the PlayLlst(), as shown In Fig. 77. 

[0255] If CPLtype In CPI() indicates the EP^map type, this 8-btt fleki Indteates the STC^sequenceJd of the contln- 
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UOU8 StC domain where therie ie placed maric Jme^stamp. If CPijType In CPi() Indicates "nj^map type, this 8-bit field 
has no meaning but is set to 0. The 8-bit field of Character.set indicates the indicating method of character letterB 
' encoded in the marK^nama field. The encoding method corresponds to the value shown In Fig. 19. 
. [0256] The 8-b(t field of name_l)ength indicates the byte length of the mark name shown in the markj.name field. This . 
5 mark.name field indicates the mark name. The byte number corresponding to the numt>er of the hamejength from 
left of this field Is the effective character number and denotes the mark narne. In the mark.name field; the values next 
■ following these effective character letters may be arbitrary: 

[0257] The field of ref.thumbnailjndex Indicates the information of the thumbnail picture appended to the mark. If 
* the ref^thumbnalljndex field is of a value different from OxFFFF, a thumbnail picture is added to its mark, with the 
10 thumbnail picture being stored in the mark.thumb file. This picture is refeiienced using the value of ref_thumbnailjndex 
In the mark.thurnb file, if the refjthumbhailjndex field Is of avalue equal to OxFFFF, a thumbnail picture is not appended 
to Its mark, 

[0258] MakerPrivateData has already been explained with reference to Fig:22 and hence is not explained here spe- 
cifically. 

13 . [0259] Next, thumbnaiijnfonfnation is explained. Athumbhall picture is stored in a menu.thmb f He or in a mark.thmb 
file. These flies are of the same syntax structure and own a sole ThuriDbnailQ. The menu.thmb file stores a picture 
representing respective piatyList8..The totality of menu thumbriails are. stored In the sole menu.thmb file. . 
[0260] the rnark.thmb file stores a mark thumbnail picture, that is a pk^ure representing.a mark point. The totatily 
of mark thumbnails corresponding to the totality of PlayLists and Clips are stored in the sole mark.thmb file. Since the 

,20 thumbnails are frequently added or deleted, the operation of addition and partial deletion must be executable readily 
and speedily; Forthls reason, ThmbnallO has a block structure. Picture data is divided Into plural portions each of whfch 
is stored In one tn.biock. One picture data is stored In consecutive tn.blocks. in the string of th_bkx:ks, there may 
exist a tn^lock not in use. The byte length of a sole thunU)nail picture is variable. 

[0261] Fig.78 shows the syntax of menu.thmb and mark.thiTib and Rg.79 the syntax of Thumbnail in tiie syntax of 
^5 menu.thmb and mark.thmb shown In Fig.78. By way of explanation of the syntax of Thurnbnail, shown in Fig.79, 
yersion^number Is four character letters denoting the version number of this ThumbnallQ. Version.number must be 
encoded to "0045" in accordance with ISO 646. 

[0262] Length is a 32-bit unsigned irtteger Indicating the number of bytes of MakerPrivatebata() as frorh directly at 
back of the length field up to the trailing end of ThumbnaliQ. Tu_block_start_address is a 32-bit unsigned Integer 

30 Indicating the leading end byte address of the first tn_block, In tenro of the relative numberof bytes.as from the leading 
end byte of Thumbnall() as a unit. The number of relative bytes Is counted from 0. Number_of_thumbnall8 is a 1 6-bit 
unsigned Integer whk;h gives the number of entries of a thumbnail picture contained In ThumbnailQ* 
[0263] Tu_block_slze Is a 1 6-blt unsigned integer which gives the size of one tn_block, In terms of 1 024 bytes as a 
unit. If, for example. tn_block^slze = 1 , It indicates that the size of one tn^block is 1024 bytes. Number_of_tn_bidcks 

35 Is 9 1 1 6-b!t unsigned integer indteating thenumbsfr of entries of tn^block in this Thumbnail. Thumbnailjndex is a 16-blt 
unsigned jnteger indicating the Index number of the thumbnail picture represented by the thumbnail Infonmation for 
one for-k>op beginning from the thumbnailjndex field. The value OxFFFF must not be used as Thumbnailjndex. This 
Thumbnailjndex is referenced t>y ref Jhumbhalljndex In UlApplnfoVolumeQ, Ul ApplnfoPlayLlstQ. PlayListMark() and 
CllpMarkO, 

40 [0264] Thumbnail_picture Jomniat is an 8-bit unsigned integer representing the pfcture fonnat of a thumbnail picture 
and assurhes a value shown In Rg.BO. In the table, DC F and PNG are allowed only in monu.thumb. The mark th umbnail 
must assume the value of "0x00" (MPEG-2 Video 1 -pjctiire). 

[0265] Pteture_data.8lze .is a 32-'bit unsigned integer indicating the byte length of a thumbnail picture in temns of 
bytes as a unjt. Startjn_blocK„number is a 16-blt. unsigned integer indicating the tn^block nurnber of the tn_block 
45 where data of the thurnb nail pictu re begins. The leading end of the thumbnail picture data must coincide with the leading 
end of the tn^block. The tn^btock nurnber begins from 0 and Is relevant to the value of a variable k In the for-loop of 

tn^biock. 

[0266] Xj)icturejength is a 16-bit unsigned integer Indicating the number of pixels In the horizorital direction of a 
frame of a thumbnail pteture. Ylptetgre Jength is a 1 6:brt unsigned integer indicating the numt)er of pixels In the vertical 
so direction of a frame pf a thumbnail pk^ture. Tn_block Is an area In which to store a thumbnail picture. All tn^block in 
the ThunnbnallO are of the same size (fixed length) and are of a 6lze defined by tn_^^ 

[0267] Flgs.81 A and 81 B schematically show how thumbnail picture data are stored In tn_blpck. If. as shown in Figs. 
81 A and 81 B. the thumbnail picture begins at the leading end of tn^block, and Is of a size exceeding 1 tn.block, it is 
- stored using the next f olk)wing tn_block. By so doing, data with a variable ler>gth can be managed as fixed length data, 
55 . so tiiat the editing of deletion can be coped with by simpler processing. 

[0268] An AV stream file Is now explained. The AV stream file Is stored In the "M2TS" directory (Fig.1 4). There are 
two types of the AV stream file, namely a Clip A stream file and a Bridge-Clip AV istream file. Both AV streams must 
be of the structure of DVR MPEG-2 transport stream file as hereinafter defined. 
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[0269] First, the DVR MPEG2 transport stream Is explained. The structure of the OVR MPEQ-2 transport stream is 
shown In Flg.82. The AV streani file has the structure of a DVR MPEG 2 transport stream. The DVR MPEG 2 transport 
stream Is made up of an integer number of Aligned units. The size of the aligned unit Is 6144 bytes (2048*3 bytes). 
The Aligned unit begins from the first byte of the source packet. Ttie source packet is 192 bytes long. One source 
5 packet Is comprised of TP.extra.header and a transport packet TP.extra^header is 4 bytes long, with the transport 
packet being 188 bytes long. 

[0270] One Aligned unit (s made up of 32 source packets. The last Aligned unit In the DVR MPEG 2 transport stream 
is also made up of 32 eource packets. Therefore, the DVR M PEG 2 transport stream ends at a boundary of the Aligned 
unit, if the number of the transport packets of the Input transport stream recorded on a disc is not a multiple of 32, a 
10 source packet having a null packet (transport packet of PID = 0x1 FFFF) must be used as the last Aligned unit. The file 
system must not use excess infonnatlon in. the DVR MPEG 2 transport stream. 

[0271] Fig.B3 shows a recorder model of the DVR MPEG 2 transport stream. The recorder shown in Flg.83 is a 
conceptual model for prescribing the recording process. The DVR MPEG 2 transport stream obeys this model. 
[0272] The Input timing of the MPEG 2 transport stream is now explained. The Input MPEG 2 transport stream is a 

15 full transport stream or a partial transport stream. The input MPEG 2 transport stream must obey the iSQ/iEC1381 6-1 
or ISO/IEC 13B1B-9. The number I byte of the MPEG 2 transport stream is Input simultaneously at time t(i) to T-STD 
(transport stream system target decoder provided for In SO/iEC13818-1) and to the source packetizer Rpk is an In- 
stantaneous maximum value of the input rate bt the transport packet. « 
[0273] A 27 MHz PLL 52 generates a frequency of 27 MHz clock. The 27 MHz clock frequency is locked at a value 

20 of the program clock reference (PGR) of the MPEG 2 transport stream. An arrival time clock counter 53 counts the 
pulses of the 27 MHz frequency. Arrlval_time_clock(l) is a count value of the arrival time clock counter at time t{l). 
[0274] A source packetizer 54 appends TP_extra_header to the totality of the transport packets to create a source 
packet. Anivai_tlme_slamp Indbates the time when the first byte of the transport packet reaches both theT-STD and 
the eource packetizer. An1vaLtlme_stamp(k) Is a sampled value of the ArrivaUlme.clock(k) as represented by the 

25 following equation: 

anrlvaLtlme_8tamp{k) » anivaUlme_clock(k)% 230 

SO where k denotes the first byte of the transport packet. 

[0275] If the time separatton between two neighboring transport packets is 230/2 7000000 sec (about. 40 sec) or 
longer, the difference of the arr1vai:.tlme_8tamp of the two transport packets should be set to 230/2 7000000 see. The 
recorder Is provided for such case. 

[0276] A smoothing buffer 56 smoothes the bitrate of the Input transport stream. The smoothing buffer must not . 
35 overflow. Rmax is the output bitralo of the source packet from the smoothing buffer when the smoothing buffer is not 
null. If the smoothing buffer is null, the output bitrate of the smoothing buffer is 0. 

[0277] Next, the parameters of the recorder model of the DVR MPEG 2 transport stream are explained. The value 
of Rmax is given by TS.recordlng.rate as defined in Cliplnfo() associated with the AV stream file. This value may be 
calculated from the following equation: 

Rmax = TSjreoording.rate*1 92/1 88 

where the value of TS_recording_rate is of a size In bytes/second, 
45 [0278] If the input transport stream Is an SESF transport stream, Rpk must be equal to TS„recording_rate as defined 
In CliplnfoO associated with the AV stream file. If the input transport stream is not an SESF transport stream, reference 
may be made to values defined e.g., in a descriptor of the MPEG 2 transport stream, such as 
maxlmum_bltrate_descrlptor or partlaLstream^descrlptor for this value. 

[0279] if the Input transport stream Is an SESF transport strearh, the smoothing buffer size is 0. If the Input transport 
50 stream Is not an SESF transport stream, reference may be made to values defined In the descriptor jof the MPEG 2 
transport stream, such as, for example, the values defined in the 8moothing.buffer.ciescrlptor, short.smoothing 
_buffer„descriptor or in the partlai_transport_stream_descrlptor; 

p)280] For the recorder and the player (reproducing apparatus), a sufficient size buffer needs to be provided. The 
default buffer size is 1536 bytes. 
55 [0281] Next, a player model of the DVR MPEG 2 transport stream Is explained. Fig.84 shows a player model of the 
DVR MPEG 2 transport stream. This Is a conceptual model for prescribing the reproduction process. The DVR MPEG 
2 transport stream obeys this model. 

[0282] A 27 MHz X-tal 81 generates the frequency of 27 MHz. An error range of the 27MHx frequency must be ±30 
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ppm (2 7000000± B1 0 Hz). The arrival timd clock counter 62 is a binary counterfor counting the pulses of the frequency 
of 27 MHz. An1val_tinne_clock(l) is a count value of the arrival time clock counter at time t(i). 
[02B3] In the smoothing buffer 64» Rmax ts the Input bitrate of the source packet to the smoothing buffer when the 
smoothing buffer is not full. If the smoothing buffer is full, the input bitrate to the smoothing buffer is 0. 
[0284] . By way of explaining the output timing of the MPEG 2 transport stream, If the arrivaLtlme^starnp of the cun^ent' 
source packet lis equal to 30 bits on the LSB side of arr{vaLtime_clock(l), the transport packet of the source packet Is 
removed from the smoothing buffer. Rpk is cm Instantaneous nrvucimum value of the trEuisport packet rate. The overflow 
of the smoothing buffer is not allowed. 

[0285] The parameters of the player model of the DVR MPEG 2 transport stream are the same as those of the 
recorder model of the DVR MPEG 2 transport stream described above. 

[0288] Fig.86 shovys the syntax of the source packet. Transpoit_packet() Is an MPEG 2 transport stream provkled 
In ISQ/IEC 13818>1 . The syntax of TP Extra^header in the syntax of the source packet shown In Fig.85 is shown In 
Rg.86. By way of explaining the syntax of the TP_Extra-header, shown in Fig.86, copyjpemnissionjndicator Is an 
integer representing the copying limitation of the payload of the transport packet. The copying limitation may be copy 
free, no more copy, copy .once or copying prohibited. Fig.87 shows the relation between the value of 
copyj>efmis8lon.indicator and the.mode it designates. 

[0287] Copy_permis8tonjndlcator is appended to the totality of transport packets. If the input trar^sport stream Is 
recorded using the iEEE1384 digital Interface* the value of copy_i>erml8sionjndlcator may be associated with the 
value of EMI (encryption mode indicator). If the Input transport stream is recorded without employing the IEEE1394' 
digital interfacOp the value of copy_penni8sion_indk>ator may be associated with.the value of the CCI embedded in the 
transport packet If an analog signal input is setf*encoded, the value of copy^rmlsebn .indicator may be associated 
with the value of CGMS-A of the analog signal. 

[0288] ArrivaLtlme.stamp is an integer having a value as specified by anivai_time_stamp in the following equation: 

anrival.time_iBtamp(k) « anrlval_time_clock(k)%230. 

[0289] By way of defining the ClipAV stream, the ClipAV stream must have a structure of the DVR M PEG 2 transport 
stream defined as doscribed above. ArrivaLtime_clock(i) must Ihcrease continuously In the Clip AV stream, if there 
30 exists a discontinuous point of the system time base (STC base) in the Clip AV stream, anrival.tlmis_ciock(i) In the Cilp 
AV stream must Increase continuously. 

[0290] The maximum value of the different of the amvaLtime^clock(l) between the beginning and the end of the Clip 
AV stream must be 26 hours. This limitation guarantees that, If there is no discontinuous point In the system time base 
(STC base) In the MPEG 2 transport stream, the PTS (presentation time stamp) of the same value never appears In 
55 the Cilp AV stream. The MPEG 2 system standard provMes that the PTS has a wraparound period of 233/90000 sec 
(about 26.5 hours). 

[0291] By way of defining the Bridge-Clip AV stream, the Bridge-CtIp AV stream must have a structure of the DVR 
MPEG 2 transport stream defined as described above. The Br1dge-Ci4^ AV stream must include a discontinuous point 
of one anival time base. The transport stream ahead and at back of the discontinuous point of the arrival time base 

40 must obey the encoding limitations and the DVR-STD as later explained. 

[0292] The present embodiment supports the video-audio seamless connection between Playitems t>elng edited. 
Seamless connection between Playitems guarantees "continuous data supply" to the player/decoder and "seamless 
decoding processing**. The "continuous data supply" Is the capability of guaranteeing data supply to the decoder at a 
bitmte necessary to. prevent buffer underflow, in order to enable ddta to be read out from.the disc as data real-time 

45 properties are assured, data Is to be stored In terms of a continuous block of a sufficlentty large size as a unit. 

[0293] The "seamless decoding processing" means the capabiitty of a player In displaying audio vkieo data recorded 
on the disc without producing pause or gap in the playback output of the decoder. 

[0294] The AV stream, referenced by the seamless connected Playitems, is explained. Whether or not the seamless 
display of a previous Playltem and the current Playltem is guaranteed may be verified from the connectton.condition 
so fieM defined In the cunnent Playltem. There are two methods for seamless connection of Playitems, that is a method 
employing Bridge-Clip and a method not employing Bridge-Clip. 

[0295] Fig.88 shows the relation. t>etween the prevtous Playltem and the cun'ent Playltem in case, of employing 
Bridge-CI^. In Rg.88, the stream data, read out by the player, Is shown shaded. In Fig.68. TS1 Is rnade up of shaded 
stream data of the Clipl (Clip AV stream) and shaded stream data previous to RSPN.arrivaLtime.discontinulty. 
S5 [0298] The shaded stream data of Clipl of TS1 Is stream data from an address of a stream required for decoding 
the presentation unit corresponding to IN.Item of the previous Playltem (shown as IN-tlmel in Fi^.es) up to the source 
packet referenced • by FtSPN_exltJromj>reviou8,Clip. The shaded stream data, prior to 
RSPN.arrlvaLtlme.discontinulty of Bridge-Clip contained in TS1 is etream data as from the first source packet of 
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Brldge^^Hp up to the source packet directly previous to the source packet referenced by 
RSPN_QrrlvaLtfrne_dl8contlnutty. 

[0297] In Fig.BB, TS2 Is made up of shaded stream data of Clip 2 (Clip AV stream) and shaded stream data subse- 
quent to RSPN.anrfvaLtime.disconltnutty of Bridge-Clip. The shaded stream data as from the 

5 RSPN.arrlval.tlme.dlscontlnulty of Brldge*Cllp contained In TS2 stream data from the source packet referenced by 
RSPN.arrlvaLtime.dlscontlnutty to the last source packet of Bridge-Clip. The shaded stream data of Clip2 of TS2 Is 
stream data from the source packet referenced by RSPN.enter_lo_currant_Clip to the address of the stream required 
for decoding the presentation unit con^spondlng to OUT_tfme of current Playltem (shown by OUT_tlme2 In Fig.88). 
[0298] Flg.B9 shows the relation between the previous Playltem and the current Playltem in case of not employing 

10 Bridge-Clip. In this case, the stream data read out by the player is shown shaded. In Fig.89,T61 is made up of shaded 
stream data of the Cllpl (Clip AV stream). Tho shaded stream data of Cilp1 of T81 is data beginning at an address of 
a stream necessary In decoding a presentation unit oorreeponding to IN.time of the previous Playltem, shown at 
IN Jime1 in Fig.SQ as far as the last source packet of CUpl. 
[0299] in Rg.89, TS2 Is shaded stream data of Clip2 (Clip AV stream). 

15 [0300] The shaded stream data of Clip2 of TS2 is stream data beginning at a first source packet of Clip2 as far as 
an address of the stream necessary for decoding the presentation unit corresponding to OLrr.time of current Playltem 
(shown at OUT.tlme2 In Fig.89}. 

[0301] In Rga.88 and 89. TS1 and T2 are continuous streams of the source packet. Next, the stream provisions of 
TS1 and TS2 and the connection conditions therebetween are scrutinized. First, encoding limitations for seamless 
20 connection are scrutinized. By way of limitations on the encoding structure of a transport stream, the number of pro- 
grams contained In TS1 and TS2 must be 1 . The number of video streams contained In TS1 and TS2 must be 1 . The 
number of audio streams contained In TS and TS2 must be 2 or less. The numbers of the audio streams contained in 
TS1 and TS2 must be equal to each other. It Is also posiBible for elementary streams or private streams other than 
those depicted above to be contained In TS1 and/or TS2. 

29 [0302] The limitations on the video bitstream are now explained. Fig.90 shows atypical seamless connection Indi- 
cated by a pk:ture display sequence. In order for a vkieo stream to be demonstrated seamlessly in the vteinity of a 
)unctk>n point, unneeded pictures displayed at back of OUT Jime1 (OiJTJime of Clipl ) and ahead of IN Jime2 (IN^tlme 
of Cllp2) must be removed by a process of re-encoding the partial stream of the Clip In the vicinity of the Junctk>n point. 
[0303] Flg.91 shows an embodiment of realizing seamless connection using BrtdgeSequence. The video stream of 

30 Bridge-Clip previous to RSPN.arrh/aLtime.dlscontinuity Is comprised of an encoded yideo stream up to a picture 
TOrrespondlng to OUT.tlmel of CUpl of Fig.90. This video stream Is connected to the video stream of previous Clipl 
and Is re-encoded to fomn an elementary stream confonning to the li^PEQ2 standard. 

[0304] The video stream of Bridge-Clip subsequent to RSPN_anivaLtlme_discoritinuity is made up of an encoded 
video stream subsequent to a picture corresponding to lN_tlme2 of Cilp2 of Flg.90. The decoding of this video stream 

S5 can be started corrsctly for connecting the vWeo stream to the next foltowlng Cilp2 video stream. Re-encodIng Is made 
such that a sole continuous elementary stream confonning to MPEG 2 standard will be formed. Forcreating Bridge-Clip, 
several pictures in general need to be re-encoded, whilst other pictures can be copied from the original Clip. 
[0305] Fig,92 shows an embodiment of realizing seamless connection without employing BridgeSequence in the 
embodiment shown in Fig.90. The Clipl video stream is comprised of an encoded video stream as far as the pioture 

40 corresponding to OLTT^tlmol of Ffg.90 and is re-encoded so as to give an elementary stream confonning to tho MPEG2 
standeuxJ. in similar manner, the vkieo stream of Clip2 is made up of encoded bitstreams subsequent to the picture 
associated with IN_thrie2 of Clip2 of Flg.90. These encoding bitstreams are already re-encoded to give a sole contin- 
uous elementary stream conforming to the MPEQ2 standard. 

[0306] By way of explaining encoding limitations of the video stream, the frame rates of the video streanw of TS1 
45 and TS2 must be equal to each other. The vkieo stream of TS1 must be terminated at aequence.end^code. The video 
stream of TS2 must connnience at Sequence header. QOP Header and with an l-plcture. The video stream of TS2 
must commence at a closed GOP. 

[0307] The video presentation units dsfined In a bitstream (frame or field) must be continuous with a Junction point 
in-between. No gap of the fields or frames are allowed to exist at Junction points. In case of encoding employing 3-2 
so pulldown, It nruiy be necessary to rewrite topJield.firsr' and "repeat JirstJIetet" flags. Altematlvety, local re-encodIng 
may be made to prevent field gaps from being produced. 

[0308] By way of explaining encoding limitations on the audio bitstream, the audio sampling frequency of TS1 and 
that of TS2 must be equal to each other. The audio encoding method of TSI and that of TS2 (for example. MPEQ1 
layer 2, AC-3, SESF LPCM and AAC) must be equal to each othsr. 
S5 [0309] By way o1 explaining encoding llmttattons on MPEG-2 transport stream, the last audk> frame of the audio 
stream of TS1 must contain audio samples having a display timing equal to the display end time of the last display 
picture of TSI . The first audio frame of the audio stream of TS2 must contain an audk> sample having a display timing 
equal to the display start timing of the first display picture of TS2. 
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i [0310] At a Junction point, no gap may be allowed to exist in a sequence of tfie audio presentation units. As shown 

\ in Fig.93, there nnay be an overiai3 defined by the length of the audio presentatfon unit less than two audio frame 

domains. The first packet transmitting an elementary stream of TS2 must be a video packet. The transport stream at 

the lunction point must obey the DVR-STD which will be explained subsequently. 
5 10311] By way of explaining Kmitatbns on the Clip and Bridge-Clip, no discontinuities in the arrival time base are 

allowed to exlsl In TS1 or In TS2. 

[0312] The following limitations are applied only to the case of employing the Bridge-Clip. The Bridge-Clip AV stream 
- has a sole discontinuous point in the arrival time base only at a Junction point of the last source packet of TS 1 and the 

I first souice packet of tS2. The SPN_arrlval_time.di8contlnulty defined In CliplnfoO represents an address of the dis- 

10 continuous pointi which must represent the address referencing the first source packet of TS2. 

[0313] The source packet r0ferenced by .RSPN^exltjTromj^revious.CI^ defined in BridgeSequencelnfoQ may be 

any source packet in Cl^1 . It Is unnecessary for this source packet to be a boundary of the Aligned unit. The source 

packet referenced by RSPN_enter_to_cui7©nt_Clip defined In BridgeSequencelnfoO may be any source packet in 

Cllp2. It Is unnecessary for this source packet to be a boundary of the Aligned unit. 
15 [0314] By way of explaining limitations on Playltem, the OUT_tlme of the previous Play Item (OUT_tlrne 1 shown in 
; Fig.89) must represent the display end tinne of the last video presentation unit of TS1 . The IN_tlme of the current 

'i PlayTlme (lN_tlme2 shown In Flg.88 and 89) must represent the display start time of the first presentation unit of TS2. 

[0315] By way of explaining the limitations on the data allodatlon In case of employing Bridge-Clip by referring to Fig. 
• 94, the seamless connection must be made to guarantee continuous data supply by the file system. This must be 

\ 20 realized by arranging the Bridge-Clip AV stream, connecting to Clipl (Clip AV stream file) and Cllp2 (Clip AV stream 

file), such as to satisfy data allocation prescriptions. 

[0316] RSPN.exit.from_prevlous„CH3 must be selected so that the stream portion of Clipl (Clip AV stream file) 
I previous to RSPN„exlt_f rom jjrevlous.Cllp will be ananged In a continuous area not less than half fragment. The data 

' length of the Bridge-Clip AV stream must be selected so that the data will be arranged In the continuous area not less 

' 25 than half fragment. RSPN_enter_to^cunBnt_Clip must be selected so that the stream portion of Cllp2 (Clip AV stream 
file) subsequent to RSPN_enter_to_current_CI!p will be arranged In a continuous area not less than half fragment. 
[0317] By way of explaining data allocation llmttatlons In case of seamless connection not employing Bridge-Clip, 
by referring to Rg.95. the seamless connection must be made so as to guarantee continuous data supply by the file 
system. This must be realized by an^nglng the last portion of the Clipl (Clip AV stream flle).and the first portion of the 
r 30 Cllp2 (Clip AV stream file) so that the provisions on data allocation will be met, 

■\ [0318] The last stream portion of Cllp1 (Clip AV stream file) must be arranged In a continuous area not less than one 

i half fragment. The first stream portion of Cllp2 (Clip AV stream file) must be anunged In a continuous area not less 

j than one half fragnrient. ^ 

[0319] In a case where digital AV signals each having a predetenmlned bit rate are fragmented and recorded on a 
j 35 disc, to assure that the recorded digital AV signals can be read out from the recording medium 1 00 in the predetermined 

bit rate/the size of one continuous recording area must satisfy the following condition: 

I S*8/ (S*8/Rud + Ts) >= Rmax 

I 40. 

where 

S: minimum size of one continuous recording area [Byte] 

Ts: access time of full stroke from one recording area to next recording area [second] 
': 45 Rud: bit rate for reading out from recording nnedium [bit/second] 

' Rmax: bit rate of AV stream [bit/second]. 

[0320] That isi the data must be arranged so that S byte or more data in the AV stream may be recorded continuously 
on the disc. 

50 [0321] The data must be arranged so that the size of the half fragment may be S byte or more. 

[03:^2] Next. DVR-STD Is explained. This DVR-STD Is a conceptual model tor modeling the decoding processing In 
! the generation and verification of the DVR MPEG 2 transport stream. The DVR-STD is also a conceptual model for 

modeling the decoding processing in the generation and verifteation of the AV stream referenced by two Playttems 
' seamlessly connected to each other as described above. 

: 35 [0323] Fig.96 shows a DVR-STD model. The model shown in Rg.96 includes, as a constituent element, a DVR 
MPEG 2 transport stream player model. The notation of n, Tbn, Mbn, Ebn, Tbsys. Bsys, Rxn, Rbxn, Rxsys, Dn. Dsys, 
On and P9(k) Is the same as that defined In T-STD of isO/lEC 1 381 8-1 . wherein n Is an Index number of an elementary 
stream and TBn Is a transport buffer of the elementary stream n. 
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[0324] MBn Is a multiplexing buffer of the elementary stream n and exists only for the vlde6 stream. EBn Is an 
elementaiy stream buffer of the elementary stream n and is present only for the video stream. TBsys Is a main buffer 
In a system target decoder tor the system information for a program being decoded. Rxn Is a transmission rate with 
which data Is removed from TBn. Rbxn is a transmission rate with which the PES packet paytoad Is removed from f^Bn 
9 and 18 present only for a video stream. 

[0328] Rxsys Is a transmission rate with which data Is removed from TBsys. On Is a decoder of the elementary stream 
n. Dsys is a decoder pertinent to the system Infomnatlon of a program being decoded. On is a re-orderIng buffer of the 
video stream n. Pn(K) ts a number k presentation unit of the elementary stream. 

[0326] The decoding process for DVR-STD Is explained. During the lime a sole DVR MPEG 2 transport stream is 
being reproduced, the timing of Inputting the transport packet to TB1 , TBn orTBsys Is determined by arrlvaLtlme_stamp 
of the soufco packet. Tho preecrlptlons for tho buffering operation of TBI , MB1 , EB1 , TBn Bn, TBsys and Beys are the 
same as those of the T-STD provided for In iSO/lEC 13818*1 , white the prescriptions for the deciding and display 
operations are also the same as the T-STD provided for in ISO/lEC 13818-1 . 

[0327] The decoding process during the time the seamlessly connected PiayUsts are being reproduced is now ex- 
f5 plained. Here, the reproductk>n of two AV streams referenced by the seamlessly connected Playltems is explained. In 
tho following explanation, the reproduction of TS1 and TS2, shown for example In Fig.88, is explained. TS1 and TS2 
are a previous stream and a current stream, respactivaty. 

[0328] Fig.97 shows a timing chart for Inputting, decoding and display of transport packets when transfening from 
a given AV stream (TS1 ) to the next AV stream seamlessly connected thereto (TS2). During transfer from a preset AV 

20 stream (TS1 ) to the next AV stream seamlessly connected thereto (TS2), the time axis of the arrival time base of TS2 
is not the same as the tln>e axis of the anival time base of TS1 (indicated by ATC1 In Flg.97). 
[0329] Moreover, the time axis of the system time base of TS2 (Indicated by ATC1 in Flg.97) is not the same as the 
time axis of the system time base of TS1 (Indteated by STC1 In Flg.97). The video display is required to be continuous 
seamlessly, however, there may be overlap In the display tine of the presentation units. 

^ [0330] The input timing to DVR-STD Is explained. During the time until time T1 . that Is until the Inputting of the last 
video packet to the TBI of DVR-STD, the Input ttming to the buffers of TBI , TBn or TBsys of DVR-STD Is detemr^lned 
by arr1vaLiime_stamp of the arrival time base of TS1 . 

[0331] The remaining packets of TS1 must be Input to buffers of TBn or to TBsys of DVR-STD at a bitrate of 
TS_recording_rate (TS1 ). The TS_recordlng_rate (TS1 ) Is the value of TS_recordlng_rate defined in Cllpinfo() corre- 
30 spending to cTlp1 . The time the last byte of TS1 Is Input to the buffer is the time T2. So. during the time between time 
T1 and time T2. arrlvaljime^stamp of the source packet Is discounted. 

[0332] If N1 is the number of bytes of the transport packet of TS1 next following the last video packet of TS1 , the 
time DT1 from time T1 until time T2 Is the time necessary for N1 bytes to be input completely at a bitrate of 
TS^recordlng.rate (TS1), and is calculated in accordance with the following equation: 

99 

DTI = T2 - T1 = N1/TS.recordlng_rate. 

[0333] During the time from time T1 until time T2 (TBI ), both the values of RXn and RXsye are changed to the value 
40 of TS-recording_rate (TS1). Except this rule, the buffering operation le the same as that of T-STD. 

[0334] At time T2, the arrival time clock counter Is reset to the value of anival Jime.stamp of the first source packet 
of TS2. The Input timing to the buffer of TBI , TBn or TBsys of DVR-STD is detemnlned by arrivaijinr>e„8tamp of the 
source packet of TB2. Both RXn and RXsys are changed to values defined In T-STD. 

[0335] By way of explaining additional audio buffering and system data buffering, the audio decoder and the system 
45 decoder need to have an additional buffering amount (data amount equivalent to one second) in addition to the buffer 
amount defined In T-STD In order to allow input data of a domain from time T1 to time T2. 

[0338] By way of explaining the video presentation timing, the display on the video presentation unit must be con- 
tinuous, that is devoid of gaps, through Junction point, it Is noted that STC1 Is the time axis of the system time base of 
TS1 (indteated as STC1 In Rg.9), while STC2 Is the time axis of the system time base of TS2 (shown at STC2 in Fig. 
90 97; conredly, STC2 begins W time the first PGR of TS2 has been input to the T-STD). 

[0337] TheoffsotbetweenSTCI andSTC2i8detemilnedastollows:thePTS1endl8thePTSonSTC1 corresponding 
to the last video presentation unit of TS2. PTS2start is PTS on STC2 corresponding to the first vteleo presentation unit 
of TS2 and Tpp Is the display time period of the last video presentation unit of TS1 . the offset STC^della between two 
system time bases Is calculated in accordance with the following equation: 

55 

STC_delta « PTSIend + Tpp - PTS28tart. 



28 



SNSOOCID: <BP llSai33Al_L> 



EP 1 1M 133 A1 

f ■ .J •} ' ^. f- ■ • , • 

[0338] By way of explanatbn of the audio presentation timing, there may be overiap in the display timing of the audio 
presentation unit, with the overlap being less than 0 to 2 audio frames (see "audio overlap" shown in Ftg.97). The 
Indication' as to which of audio samples Is to be selected and re-synchronlzatlon of the display of the audio presentation 
unit to the corrected time base at back of thiB Junction point are set on the player. 
5 . [0339] . By way of explaining the system time dock of DVR-STD, the laist audio presentation unit of T81 Is displayed 
at time T5. The system tinne clock may be overlapped between time T2 and time T5'. Dyririg this time domain, the 
DVR-STD switches the system time clocks between the value of the otd time t>ase (STC1) and the value of the new - 
time base (STC2). The value of STC2 may be calculated in accordance with. the following equation: 

. STC2 = STC1-STC_delta. 

[0340] The buffering continuity Is explained. STCHvldeo.end is the value of STC on the system time base STC2 
when the first byte of the first video packet reaches TBI of DVR-STD. STC22vldeo_start is the value of STC on the 
15 system time base STC2 when the first byte of the first video packet reaches TBI of DVR-STD. STC21 vldeo^end is 
the value, of STCIIvldeo.end calculated as the value on STC2 of the system Wme bese STC2. STC21 video.end is 
. calculated. In »x»rdance with the following equation: * . * 

^ STG21vldeo_end = STC11vltfeo_end-STC_deita. 

[0341] In order to obey DVR-STD, the following two conditions must be met: First, the anrtval timing of the first video 
packet of TS2 at TB1 must satisfy the following Inequality: 

STC22yldeo_stait>STC21vldeo_end.4- ATI. 

[0342] If it is necessary to re-encode and/or multiplex the partial stream of Cltp1 and/or Ctip2, In such a nr>anner that 
the above inequality will be satisfied, this re-encoding or multiplexing is perfomied as appropriate. 
30 [0343] Second, the inputting of the video packet frohnTSI followed by the Inputting of the video packet from TS2 on 
the time axis of the system time base, map|)ed from STCI and STC2 on the same time axis, must not overflow or 
underf tow the video buffer. 

[0344] if the above syntax, data structure and the rules are used as basis, the contents of data recorded on the 
recording medium or the reproduction information can t>e managed property lb enable the user to confirm the contents 
35 of data recorded on the recording medium at the time of reproduction or to reproduce desired data extremely readily. 
[0346] In the above-described embodiment, the MPEG 2 transport stream Is taken as an example of the multiplexed 
stream. This, however, Is merely exemplary, such that the M PEQ 2 program strearn DSS or the transport stream used 
in the DirecTV Service (trade mark) of USA may also be used as the nriuttiplexed stream. 

[0346] Fig.98 shows a modification of BrldgeSequencelnfo(). The di^erence from the BrIdgeSequencelnfoO of Fig. 

40 38 is that it contains only Bridge_ClfpJnfonTiatlon_fiie_hame. 

[0347] Flg.99 Illustrates Bridge^Clip when two Playltems are seamlessly connected in case of using the syntax of 
BridgeSequoncelnfoO of Fig.98. RSPN_exit Jrom j>reviou8_Cllp is the source packet number of the source packet on 
the Clip AV stream referenced by the previous Piayltem. Next to this source packet is connected the f iret source.packet 
of the Bridge.Cllp AV stream file. . . > 

45 [0348] RSPN_enter^to.cun^ent_Ciip is the nunnber of the source packet on the Clip AV stream referenced by the 
cunrent Piayltem. Ahead of this source packet is connected the last source packet of the Bridge-Clip AV stream file 
referenced by the current Piayltem. in the Bridge-Clip AV stream, shown in Fig.99, SPN_ATC_start indicates the source 
packet number of the source p&c^eX in the Bridge-Clip AV stream file at which comrnences the time axis of new arrival 
time base. 

50 [0349] The Bridge^iip AV stream ffle has a sole anival time base discontinuous point. The second SPN_ATC_start 
in the drawings has the same meaning as that of the RSPN.arrtvaljrme.discontinuity in Flg.37. 
[0350] If the syntax of BrIdgeSequencelnfoO of Fig.98 is used, RSPN_exit_from_preylous_Clip and 
RSPN.enterJo.cun^ent^Ciip are stored in the Clip Infonnatlon file con-espondlng to the Bddge-Ciip AV stream file. 
SPN_ATC_start is also stored in the Clip infonnatlon file. 

55 [0351 ] Flg.1 bo shows the syntax of the Clip Inf onmation file when the BrIdgeSequencel nfo is of the syntax of Rg.98. 
Sequence!nfo_start_addre8S indicates the leading. address of SequencelnfoQ, in temns of the number of relative bytes 
from the leading byte of the Clip Information fite as a unit. The number of relative bytes is counted from 6. 
. [0352] Fig. 1 01 shows the syntax of Cllpinf o() of the Clip Inf onmation file of Fig.1 CO. Cllp.stream.type Indicates wheth* 
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er the AV stream file of the Clip Is the Clip AV stream file or the Bridge-Clip AV stream file. If the Cllp.stream^type 
Indicates the Bridge-Clip AV stream file, the next syntax field follows. 

[0363] Previous.Cilp_lnrormation_flle_name Indicates the Clip Infomnation file name connected ahead of the 
Bridge-Clip AV stream file. RSPN.exit^from^prevlous.CKp is the source packet number of the source packet on the 

9 Clip AV stream file Indicated by prevtou8_Cilp.tnfomiattonJile.name. Next to this source packet is connected the first 
source packet of the Bridge-Clip AV stream file. TTils source packet number Is counted as from the first source packet 
of the Clip AV stream file, with 0 as an initial value. 

[0354] Cun-ent^Ciip.infomiatton.fiie.name Indicates the Cl^ Infomnation file name of the Clip connected at back of 
the BrUge-Ct^ AV stream file. RSPN_enter.to_current_Cllp is the source packet numt>er of the source packet on the 

10 Clip AV stream file Indteated by the current.Clip.lnformation.file.name. Ahead of this source packet is connected the 
last source packet of the Bridge-Clip AV stream file. This source packet number Is the is counted as from the first 
source packet of the Clip with the AV stream file with 0 as an initial value. 

[038S] Flg.102 Indbates the syntax of the. SequenoelnfoO the Clip Infonratlon file of Fig.100. 
Num.of.ATC.8equence indicates the number of the ATC.sequence in the AV streemi file. ATC_sequerice is a source 
IS packet sequence not containing discontinuous points of the arrival time base. In the case of Bridge-Clip, this value is 2. 
[0366] SPN_ATC_start[atc_id] indicates an address at which connmences the arrival time base indicated by atcjd 
on the AV stream file. SPN_ATC_start[atcJd] Is of a size based on the source packet number as unit and is counted 
as from the first source packet of the AV stream file with 0 as an initial value. 

[0367] Flgs.1 03A and 1 03B illustrate database change In case stream data of the Clip AV stream f lis referenced by 
20 Bridge-Sequence Is partially erased. It is assumed that, as Indicated by "Before Editing" in Fig.103A, Cllpl and Clip2 
are Intercorinected by Bridge-Cllp. with RSPN_exit_fromjDreviou8_Clip = X and.RSPN_enter_to_current.Cllp = Y 
[0366] it is assumed that a stream data portion of Z1 source packets of Ciip1 » shown shaded, and a stream data 
portk)n of Z1 source packets of Cllp2, likewise shown shaded, are to be erased. As a result, 
RSPN_exlt.from_previous_Cllp becomes equal to X- Z1 and RSPN.enter.to_current_Ciip becomes equal to Y-22, 
2S by way of value changing, as Indicated by "After Editing" In Flg.1 03B. 

[0369] By changing the syntax of the database pertinent to BrIdgeSequence as shown in Flg8.96 and 1 01 , the Infor- 
mation pertinent to the source packet number indicating a data address in the AV stream -(a field commencing from 
RSPN in the database syntax) is depleted from the layer of the PlayUst, such that the totality of the Infonnatton on the 
source packet number is stated in the Clip layer. 
so [0360] In this case, tf it Is necessary to change the yalue of the data address in the AV stream, as when data of the 
AV stream file has been partially erased, it Is only sutfk^lent if measly the Clip information file is supervised as data, 
thus advantageously facilitating database management 

[0361] Flg.1 04 Is a flowchart Illustrating the preparation of the RealPiayLlst. Reference Is had to the block diagram 
of Flg.1 showing the recording and^or reproducing apparatus 1 . At step 31 0, a controller 23 records a Clip AV stream. 

39 At Step 811 , the conlroiier 23 fomis PiayUslQ made up of Play Items covering the totality of the possible playback range 
of the above Clip. If there Is STC discontinuous point in the Clip, and PlayList() is made up of two or more Playltems, 
the connection_condition between the Playltems Is also determined. 

[0362] At step S12, the controller 23 fonms UlApplnfoPiayLlstO. At step S1 3, the controller 23 fomis PlayListMark. 
At etep 1 4, the controller 23 f onns MakersPrlvateData. At step 81 5, the controller 23 records a Real PlayUst file. In 

40 this manner, one Real PlayUat file is created eaoh time a Clip AV stream file is newly recorded, 

[0363] Fig.lOS is a flowchart for Illustrating the fontiulatton of a Virtual PlayUst having a bridge sequence. At step 
S20, reproduction of one Real PlayUst recorded on the disc Is specified through a user interface. From the reproduction 
range of the Real PlayUst, the reproduction domain specified IN and OUT points Is specified through user interface. 
[0364] At step S21 , the controiier 23 verifies whether or not the operation of specifying the reproduction range by 

45 the user has been finished In Its entirety. If it is verified that the specifying operation has been finished, the controller 
. 23 proceeds to step 822 and, if otherwise, the controiier 23 reverts to step 820 to repeat the subsequent processing: 
[0366] At step 822, the user detemilnes the connection condition between two continuously rejbroduced Playltenw 
(connectlon^conditlon), through user interface, or the controiier 23 detemilnes the connection condition. At step S23, 
the controiier 23 fomis a bridge sequence for the seamlessly connected Playltems. At step 854, tghe controller 23 

90 forms and records the Virtual PlayUst file. 

[0366] Fig.1 06 is a flowchart for illustrating the detailed processing at step S23. At step 831 , the controiier 23 re- 
encodss and re-muitlpiexes an AV stream on the OUT point skle of the Piayltem displayed on the temporally forward 
side. At step 832, the controller 23. re-encodes and re-multiplexes the AV stream on the IN point side of the Piayltem 
represented next to the Piayltem. 

S9 [0367] At step 833, the controiier 23 determines the value of the RSPN_exit Jrom j3revious_Clip such as to satisfy 
the data allocation condition for continuous data supply. That is, R8PN_exit_from.^prevlous_Cllp must be selected so 
that the stream portion of the Clip AV stream file previous to R8PN.exitJrom.previous.Clip will be recorded in a 
continuous area not less than the aforementioned half fragment on the recording medium (see Flgs.61 and e4). 
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[0368] At step S34, the controller 23 determines the value of RSPN^enter^^to^current^Clip such as to satisfy the 
. data allocation condition for continuous data supply. That Is, RSPN_enter_to_current_Clip must be selected so that 
the stream portion of the AV stream file subsequent to RSPN.enter.to.current.Clip will be arreyed In a continuous - 
area not less than the aforementioned one fragment on the recording medium (see Figs.si and 94). 
5 [0869] At step S35. the controller 23 forms the. Bridge-Clip AV stream file such as to satisfy the data allocation con- . 
dltlon for continuous data supply. That Is, if the volume of data prepared In the processing of steps S31 and S32 is less 
than the size of the aforementioned one half fraspnent, data is copied from the original Clip to prepare Bridge-CI^ (see 
Flgs.91 and 94). . 

[0970] Although the processing operations of steps 833 to 835 is explained chronologically, these processing oper- 
10 . atlons may al^o be carried out nbn-sequentlally or simultaneously since these processing operations are relevant 

reoiprocaliy. 

[0371] At step 836, the controller 23 fonms a bridge sequence database. At step S37, the controller 23 records a 
Bridge-Clip AV stream file and Its Clip Infofmation file. In this manner, one or more Playltem is selected by the user 
from the reproduction range of Real PlayList recorded on the disc. A bridge sequence for enabling seamless connection 
19. of two Playltems is fomied and a set of one or more Playltems, grouped together, is recorded as one Virtual P|ayUst. 
[0372] Fig.1 07 is a flowchart for illustrating the reproduction of PlayList. At step 341 , the controller 23 acquires Info, 
dvr, a Clip Infonnatlon file, a PlayList file and the thumbnail Intonnation to prepare a GUI picture a list of PloyLlsls 
recorded on the disc to display the so fomied picture on the GUI through user Interface. 

[0373] At step 842, the controller 23 presents the information Olustratihg the PlayList on the QUI picture based on 
50 UlApplnfpPlayListO of each PlayList. At step S43, the user Instructs reproduction of one PlayList from the GUI picture 

through a user Interface. At step 844, the contiroller 23 acquires, from the PTS of IN^tlme and 8TC-sequecne-ld of the 

current Playltehi. a source packet having an entry point temporally previous and closest to IN.tlme. 

[0374] At step 846, the controller 23 reads out data of the AV stream f rorri the source packet number haying the 

above entry point to send the so read out data to decoder. If, at step 846, there is any Playltem temporally previous 
25 to the current Playlteni, the controller 23 perfonns the processing of Interconnecting the previous Playltem and the 

current Playltem In accordance with connection_condltlon. If the Playltems are Interconnected seamlessly, the AV 

stream is decoded based on the DVR-8TD decoding method. 

[03TO] At step i547, the controller 23 commands the AV decoder 27 to start the display as from the pteture of the 
PTS of IN^tlme. At step 848, the controller 23 conrimands the AV decoder 27 to continue decoding the AV stream. At 

30 step 849, the controller 23 viarlfles whether or not the pteture currently displayed Is the picture of PTS of OUTjme. If 
It Is verified that the pteture cufrently displayed Is not the picture of PTS of OUTJme, the controller 23 proceeds to 
step S60 to display the picture, after whteh the controller 23 reverts to step S4B to repeat the subsequent processing. 
[0376] If it Is verified at step 849 that ths picture cun^mly displayed is the picture of PTS of OUT_tlme, the controller- 
23 proceeds to step 861 where the controller 23 vermes whether or not the current Playltem Is the last one In the 

35 PlayList. If It is verified that the current Rayltem Is not the last one, the controller 23 reverts to step 844 to ropeat the 
subsequent processing. If It Is verified that the current Playltem IS the last one. reproduction of the PlayList Is finished. 
[0377] In this manner, the one PlayList file; specified to be reproduced by the user. Is reproduced. 
[0378] Based on ths above-described aiyntax, data structure and rule, as described above, the contents of data 
recorded on the recording medium, the playback Information and so forth can be properly managed to enable the user 

40 to oonflm) the contents of data.reoorded on the recording medium properly to reproduce the desired dale extremely 
readily. 

Jpmy The above-described sequence of operations may be executed not only by hardware but also by software. If 
the sequence of operations Is to be executed by softwiare, it is Installed hrom a recording medium to a computer In the 
dedicated hardware of which is Instaned the program fomnlng the software or to e.g., e general-purpose personal 

•45 computercapable of executing various functions based on a variety of programs Installed therein. 

[0360] Rg.i 08 shows an Illustrative inner stmcture of a general-purpose computer. A CPU (central processing unit) 
201 of the personal computer executes a variety of processing operations in accordance with a program stored in a 
ROIWI (read-only memory) 202. In a RAM (random-access memory) 203, there are suitably stored data or progranr^ 
necessary for the CPU 201 to execute various processing operattohs. To an Input/output Interface 205 is connected 

so an Input unit 206 fomied by a keyboard, a mouse and so forth to output signals input to the Input unit 206 to the CPU 
201 . To thg Input/output Interface 205, there Is also connected an output unit 207 made up of a display, a loudspeaker 
and so forth. 

.[0361] To the Input/output Interface 205, there are also connected a recording unit 208 made up e.g., of a hard disc 
and a communteation unit 209 adapted for exchanging data with outer equipment over a networic, such as Internet. A 
s5 drive 21 0 Is used for reading out or writing data on or from a recording medium, such as a magnette disc 221 , an optical 
disc 222, a magneto-optical disc 223 or a semiconductor rnemory 224. 

[0362] The recording medium Is constituted not onljf by a package medium distributed for furnishing the program to 
the user, in addition to a computer, such as a magnetic disc 221 carrying the program thereon, inclusive of a fjoppy 
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dl6C» an opticdl di8c 222. Inclusive of a CD-ROM (Compact DIac-Read-Only memory) or a DVD (Digital Versatile Disc), 
a magneto-optical disc 223, inclusive of a Mini-Disc, or a semiconductor memory 224, but also by a hard disc, inclusive 
of a ROM 202 carrying a program and a memory 208, furnished to the user as it is built-in in a computer, as shown In 
Fig.108. 

[0333] In the present specification, the steps of the program furnished by the medium Include hot only the chrono- 
logical processing In accordance with the sequence Indicated, but also the processing performed not chronologically 
but in parallel or separately. 

[0334] AddltioncUly, In the specification, the system means an entire apparatus comprised of plurcU conr^onent de- 
vtcea. 

10 

Industrtal Applicability 

[0336] In the Infomnatlon processing method end apparatus, and the program, aocording to the present Invention, If 
the It is commanded to perform reproduction continuously from the first AV stream to the second AV stresim, there is 

15 generated a third AV stream made up of a preset portion of the first AV stream and a preset portion of the second AV 
stream and which Is reproduced when reproduction Is switched from the first AV stream to the second AV stream, while 
there Is generated, as the Information pertinent to the third AV stream, the address Infonnatlpn made up of the Infor- 
mation on an address of a source packet of the first AV stream at a timing of switching of reproduction from the first 
AV stream to the third AV stream, and of the Infomnatlon on the address of a source packet of the second AV stream 

20 at a timing of switching of reproduction from the third AV stream to the second AV stream. So. reproduction may be 
achieved such as to maintain continuity In separately recorded AV streams. 

[0386] In the Infonmation processing method and apparatus, and the program, according to the present invention, a 
first AV stream, a second AV stream or a third AV stream is read out from a recording medium, the address infonnation 
made up of the infonnation on an address of a source packet of the first AV stream at a timing of switching of reproduction 

25 from the first AV stream to the third AV stream, and the infonnation on the address of a source pack^ of the second 
AV stream at a timing of switching of reproduction from the third AV stream to the second AV stream, is read out from 
the recording medium as the infonnation pertinent to the third AV stream, and reproduction is switched from the first 
AV stream to the third AV stream and from the third AV stream to the second AV stream, as reproduction proceeds, 
based on the read-out infonnation pertinent to the third AV stream. So, reproduction may be achieved such as to 

so maintain continuity In separately recorded AV streams. 



Claims 



59 1. An Information processing apparatus connprlsing: * 

generating means for generating, In case continuous reproduction from a first AV stream to a second AV stream 
Is commanded, a third AV stream made up of a preset portion of said firet AV stream and a preset portion of 
said second AV stream, said third AV stream being reproduced when reproduction is switched from said first 

40 AV stream to said second AV atream. arid the address Infonnation, as the information pertinent to said third 

AV stream, said address Infonnation being made up of the rnfdmnatlon on an address of a source packet of 
said first AV stream at a timing of switching of reproduction from said first AV stream to said third AV stream, 
and of the informatk>n on the address of a source packet of said second AV stream at a timing of switching of 
reproduction from said third AV stream to said second AV stream; and 

45 recording means for recording said third AV stream and said address information, as generated by said gen- 

erating means. 

2. The Infomnatlon processing apparatus according to claim 1 wherein an anival time stamp of the aource packet of 
said first AV stream Included in said address infomnatton generated by said generating means, and an anlvai time. 
so stamp of a source packet k>cated at a leading end of said third AV stream, are continuous to each other, and 

wherein an anrtval time stamp of the source packet of said second AV stream Included In said address Information 
generated by said generating means and ah anival time stamp of a source packet located at a trailing end of said 
third AV stream are continuous to each other 

59 3. The lnfonnatk>n processing apparatus according to claim 2 wherein a sole discontinuous point exists in the arrival 
time stamp of the source packet in sak:! third AV stream. 

4. The infonnation processing apparatus according to claim 2 wherein said address Is detenrnlned so that a data 
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portion of the AV stream previous to a source packet specified by the information on the address of the source 
packet of said first AV streann contained in said address information generated by said generating means will be 
located In a continuous area of not less than a preset size on a recording medium. 

5 5. The Information processing apparatus according to claim 2 wherein said address is determined so that a data 
portion of the AV stream subsequent to a source packet specified i^y the information on the address of the source 
packet of said second AV stream contained in said address Infomiatlon generated by said generating means will 
be located In a continuous area of not less than a preset size on a recording medium. 

to 6. The infomnation processing apparatus eocoreling to daftti 2 wherein said third AV stream Is generated so that said 
third AV stream will be located In a continuous area of not less than a preset size on said recording medium. 

7. An information generating rf>e1hod comprising: 

15 a step of generating, in case continuous reproduction from a first AV stream to a second AV stream is conv 

mended, a third AV streem made up of a preset portion of said first AV strearn and a preset portion of said 
second AV stream, said third AV stream being reproduced when reproduction Is switched from said first AV 
stream to said second AV stream, and 

a step of generating the address infonmatlon. as the information pertinent to said third AV stream, saM address 
20 information being made up of the infomiation on an address of a source packet of said first AV stream at a 

timing of switching of reproduction from saki first AV stream to said third AV stream, and of the infonnation on 
. the address of a source packet of said second AV stream at a timing of switching of reproduction from said 
. thlrdAVstreamtosaldsecondAV stream. 

» 8. A recording medium having recorded thereon a computer-readable program, said program comprising: 

a step of generating, in case continuous reprbductk>n from a first AV stream to a second AV stream is com- 
manded, a third AV stream made up of a preset portion of said first AV stream and a preset portion of said 
second AV stream, said third AV stream being reproduced when reproduction is switphed from said first AV' 
stream to said second AV stream, and 

a step of generating the address Infonnation, as the infomiation pertinenttp said third AV stream, said address 
infomiation being made up of the infomiatlon on an address of a source packet of said first AV stream at a 
timing of switching of reproduction from sakJ first AV stream to sakf thii'd AV stream, and of the information on 
the address of a source packet of said second AV stream at a timing of switching of reproduction from sakj 
third AV stream to said second AV stream. 

9. A program for having a computer execute a program, said program comprising: 

a step of generating. In case continuous reproduction from a first AV stream to a second AV stream Is com- 
manded, a third AV stream made up of a preset portk>n of said first AV stream and a preset portion of sakJ 
second AV stream, said third AV stream being reproduced when reproduction is switched from said first AV 
stream to said second AV stream, and 

a step of generating the address Information, as the information pertinent to said third AV stream, said address 
Information being made up of the InfonmaticHi on an address of a source packet of said first AV stream at a 
timing of swhching of reproduction from said first AV streann to said third AV stream, and of the Information on 
the address of a source packet of said s^econd AV stream at a timing of switching of reprodtntlon from said 
third AV stream to saM second AV stream. 

. 10: An Infbmiatlon processing apparatus comprising: 

so ' 

. first readout nrieans for reading out a first AV stream, a second AV stream or a third AV stream from a recording 
niedium; 

second readout means for reading out, as the information pertinent to said third AV stream, the infomiation 
on an address of a source packet of said first AV stream at a timing of switching of reproduction from said first 
55 AV Stream to said third AV stream, and of the Infomnatlon on the address of a source packet of said second 

AV stream at a timing of switching of reproduction from said third AV stream to said second AV stream; and 
reproducing means for perfomilng reproduction as reproduction is switched f ronni said first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to said second AV stream, 
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based on the Information pertinent to eald third AV stream read out by said second readout nr^eans. 

11. An Information processing method comprising: 

5 a first readout controlling step of reading out a first AV stream, a second AV stream or a third AV stream from 

a recording medium; 

a second readout controlling step of reading out, as the Information pertinent to said third AV stream, the 
Infomnation on an address of a source packet of said first AV stream at a timing of switching of reproduction 
from said first AV stream to said third AV stream, and of the fnfomiatlon on the address of a source paci<et of 
^0 said second AV stream at a tirning of switching of reproduction from said third AV stream to said second AV 

stream; and 

a reproducing step of performing reproduction as reproduction Is switched from eald first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to said seoond AV stream, 
based on the Information pertinent to said third AV stream read out by said second readout means. 

15 

12. A recording medium having recorded thereon a computer-readable program, said program comprising: 

a first readout controlling step of reading out a first AV stream, a second AV stream or a third AV stream from 
a recording medium; 

20 a second readout controiling step of reading out. as the Infomiation pertinent to said third AV stream^ the 

infomr^ation on an address of a source peclcet of said first AV stream at a timing of switching of reproduction 
from said first AV stream to said third AV stream, and of the infomnation on the address of a source packet of 
said second AV stream at a timing of switching of reproduction from said third AV stream to said second AV 
stream; and 

25 a reproducing step of perfomr^ing reproduction as reproduction is switched from said first AV stream read out 

by said first readout means to said third AV stream and from said third AV stream to said second AV stream, 
based on the infomnation pertinent to said third AV stream read out by said second readout means. 

13. A program for having a computer execute a program, said program comprising: 

30 

a first readout controlling step o1 reading out a first AV stream, a second AV stream or a third AV stream from 
a recording medium; 

a second readout controlling step of reading out, as the Infomiadon pertinent to said third AV stream, the 
Information on an address of a source packet of said first AV stream at a timing of switching of reproduction 
» from said first AV stream to said third AV stream, and of the infomnation on the address of a source packet of 

said second AV stream at a timing of switching of reproduction from said third AV stream to said second AV 
stream; and 

a reproducing step of perfomiing reproduction as reproduction is switched from said first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to eald seoond AV stream, 
40 based on the Infontiatlon pertinent to said third AV stream read out by said second readout means. 

14. A recording medium having recorded thereon the address information comprising, in case continuous reproduction 
from a first AV stream to a second AV stream is commanded, a third AV stream nriade up of a preset portion of 
said first AV stream and a preset portion of said second AV stream, saki third AV stream being reproduced when 

45 reproduction la switched from said first AV stream to said second AV stream, and the address Information, as the 

Information pertinent to said third AV stream, said address Information being made up of the Infomiatlon on an 
address of a source packet of said first AV stream at a timing of switching of reproduction from said first AV stream 
to said third AV stream, and of the Information on the address of a source packet of said second AV stream at a 
timing of switching of reproduction from said third AV stream to said seoond AV stream. 

50 



.55 



34 



BNSDOCID: <EP 110ei33AlJ_> 



EP 1 198 133 A1 



Vohime Information 



■• FlayList 

Hayltem Hayltem Playltem 



— PlaylJst — 



Time Stamp 



Clip Information 1 


' ' 1 


byte 




r 


Clip AV stream i 








Clip— 



' 1 

I 

i • 


li 


; i 




F ^ ! 









Clip 




FiG.2 



BNSDOCID: <eP L-119e<33AlJ^> 



36 



f ■ . . 

• 1 - • * . ■ 

{ 

EP1198133A1 



/TOINI' 



OUT ••.^ouT 

POINT; \POINT 
^IN : IN \ 
?0m iPOlNTx \ 



ThneStai^^^ 



Clip Information 
byte 

Clip AV stream 



Clip 




-S-IN 
! POINT 



POINT 



our 

POINT 



WW 



Clip 




FIG.3 



37 



EP 1 198 133 A1 



Real Playliat 



Clip 



Real PlayUst 














Clip 



FiG.4A 



DIVISION POINT 



Real FlayLlst 



CUp 



=> 



PlayUst 



Real 
PlayUst 



Clip 



r 



FiG.4B 



Real 
PtoyLtetl 



COUPUNG 



Clipl 



feea! 
PhyU8t2 




Real PlayUstl 






\. : 








Cl!p2 


Clipl 


Clip2 



FIG.4C 



38 



EP1 198133A1 



RealPlayUst 



CKp 



K BOTH Real PlwUst 
[=> ANDCMpARE 
y DELETED 



FIG.5A 



ic=4i 



DELETED 



Real Playliat 



Hayltem, 



CUp 



1^ 

\ 



CUp 



FIGSB 



DELETED 



Real PlayList 



1^ 



Oip 



DELETED 




DELETED 



Real Pla yList 



Clip 



FIG.5C 



39 



EP 1196 133 A1 



FIG.6A 



IN OUT 
POINT 1 POINT 1 


IN 
P0INT2 


our 

P0INT2 




Real PlayUstl 




Real PlayLi8t2 












— ^ 


Clipl 


CUp2 



FIG.6B 



IN 

POINT Ix 



,PlayItem^ <:j,in;^ 
^ i S i POINT 1 



IN OW 
.POim'2 POINT 2 

Playltem \, 



I 


teal PlaylisU 








CUpl j 



Real PlayList2 




, : . ■ 




CUp2 1 



BNSOOCIO: <EP 1l9et3aAlJ^> 



40 



'^P1 198133A1 • 



-Virtual Playlist 

Playltem 
(MAIN PATH) 

K . . . =0. 



Subl^ayltem 
(SUB-PATH) 



J 



it 



IN 
POINT 1 



I OUT 
j^POINTl 





Reial Flaylistl 






. : j 






Clipl 






(MAIN AV STREAM) 





IN 

^P0INr2 



OUT 



Real Flaylist2 



CUp2 

(SUPPLEMENTARY 
AUDIO STREAM) 



F1G.7 



41 



.GK8 > ID:<EP_ 



^119ei3aA1J_> 



EP 1 198 133 A1 



REPLAY SEQUENCE 



RealPlayListl 



Real Playli8t2 
i Virtual HayUstl 



Virtual PlayListTl 



Real PlayLtst2 
RealPlayListT^ 



FIG.8 



42 



EP1 198 133 A1 



PlayUst I 



PlayDst 



Playlist 



RESUMING 
BOOKMARK POINT 



Clip 




SCENE 



RESUMING 
POINT 



4h 



SQgNE 




FIG.9 



43 



^BM8 iPCID: <EP_ 



:_ii©ai3aAij_?' 



EP 1 198 133 A1 



VOLUME 



PERSONAL 
COMPUTER 
(PC) 



DECnWL 

srnx 

CAMERA(DSC) 



IN-VOLUME 
IMAGE 



C 



MENU THUMBNAIL 



FiG.10 



PLAYUST 



PC 



PlayXist 



PLAYUST MARK 



DSC 



^ \^ [_i 



MENU THUMBNAIL MARK THUMBNAIL 



FIG.1 1 



BNSCXXID: <eP 1J98133A1J_> 



44 



EP1 198 133 A1 



CUP 



Clip c 



CUP MARK 



(ZZI 



MARK THUMBNAIL 



FIG.12 



1 



VOUJME 
THUMBNAIL 



V\iesgUslt 



cup 



THUMBNAIL 
PICTURE 




FIG.13 



45 



ID; <EP 1 loeisaAi 



EP1 198 133 A1 



root — DVR 



^ info.dvr 
menu.thmb 



mark.thmb 



PLAYUST 



OlOOLrpls 



02002.rpls 



99999.tpls 





CUPINF 




O1000.clpi 








O2000.clpi 








OSOOO.clpi 












M2TS 




O100O.m2ts 








02000.in2t8 






— 


O3000.ni2ts 



L- DATA 



FIG.14 



BNSOOCID: «EP 1l9ei33AtJ.> 



46 



EP 1 Ids 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIAHON 


info.dvr { 






l^bleOfPlayLists.Start.address 


32 


uimsbf 


MakersPrlyateDataJStart_addr«8s 


32 


uitnshf 


reserved 


192 


bslbf 


DVRVoluineO 






fQr(l«0;i<Nl;i++)( 






i>a<lding:.word . ■ 


16 


bslbf . 


I 






IkbleOfPlayLlstsO 






for(ioO;i<N2;i++)t 






padding:.word 


16 


bslbf 


} 






MakersPrivateDataO 













FIG.15 



110ei33AlJ_> 



47 



EP 1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


DVRVolumeOf 






Terslon_noinber 


8*4 


bslbf 


length 


32 


uimsbf 


ResumeVolumeO 






tJIAppInfoVoliiroeO 






i 







FIG.16 



BNSOOCID: <EP 1108133A1 J_> 



48 



• .. ■ ■ . . . . ■ : . • .\ 

EP1198133A1 

s 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


ResumeVohuneO ( 






reserved 


15 


bslbf 




1 


bslbf 


KSomeJPlayLfstjname 


8*10 


bslbf 


) 







FIQ.17 



BN8 ID: <EP. 



49 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


UIAppInfoVolumeOi 






character jset 


8 


bslbf 


namejlength 


6 


uimsbf 


. Volu0ML.naiiie 


8*256 


bslbf 


merved 


15 


bslbf 


Volttme_^roteetJlag 


1 


bslbf 


PIN 


8*4 


bslbf 


ref thumbnaULlnd^ 


16 


uimsbf 


reserved_for_|tature_ii8e 


256 


bslbf 


1 







FIG.18 



118ei33A1_ I > 



80 



EP1 198 133 A1 



VALUE 



CHARACTER LETTER ENCODING 



QxOO 



Reserved 



0x01 



ISO/IEC 646 (ASCII) 



0x02 
QxO»4)xff 



ISO/IEC 10646-1 (tf nfcode) 
Reseived 



FIG.19 



ID:.<EP IIWiaaAIJ^ 



51 



EP 1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


TableOfPlayUstaOl 






ver8ion_number 


8*4 


bslbf 


length 


32 


uimsbf 


nomber of.PlayLJsts 


16 


uimsbf 


for G-0: Knumber of_J*iaylJsts'. 






PlayList flle_naine 


8*10 


bslbf 


} 






1 







FIG.20 



iioeiaaAi I > 



82 



EP1 1M133A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


TableOfPlayUstsOt 






verdon_niunber 


8*4 


bslbf 


lenfith 


32 






16 


'. uimsbf 


&r (1-0; \<numberjnifJ>layUstsr, i++) { 






nayLlst filejname 


8*10 


bslbf 


UlAppInfoPlayListO 






\ 






> 







FIG.21 



10! <6P_:_110ei33A1J.> 



53 



/ 



EP 1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


MakersPrivateDataO { 






versio]iL,number 


8*4 


bslbf 


length 


32 


uimsbf 


if Oength I«0){ 






mod block8_9tart_address 


32 


uimsbf 


number of maker entries 


16 


uimsbf 


mpd block jsize 


16 


uimsbf 


nnmber of mpd blocks 


16 


uimsbf 


reserved 


16 


bslbf 


for (i-O; l<numderjif/jnaker^entriesi 






nuk«r_jn> 


16 


uimsbf 


roaker_model code 


16 


uimsDi 


start mpd.block number 


16 


uimsbf 


reserved 


16 


bslbf 


mipdJength 


32 


utmsbf 


) 






stufllngLbytes 


8*2*U 


bslbf 


forfl-0; }<number_o/.jTvdJbUKks; ( 






mpdJI>lock 


mpd_block_ 
size* 1024*8 




1 






1 






) 







FIG.22 



S4 

BNSDOCID:<EP 1108133A1J,> 



EP1 198133A1 



-SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


xxxxxJids / yyyyy.vplB ( 






nayLtotMarkjStart_addre» 


32 


uimsbf 


MakersPriyateD«tiLj5tert_address 


32 


uimsbf 


reserved 


192 


bslbf 


FlayLbtO 






for 0-O;i<Nl;i++){ 






paddin8_word 


16 


bslbf 


) 






PlayListMarkO 






forCi-0;I<N2;i++){ 






padding-Word 


16 


bslM 


1 






MbkersPrlTateDataO 






1 







FIG.23 



EP1 198 133 A1 



Real PlayUst 



Real PlayUst 



Real Playlist 



Real PlayUst 



1 Clip 1 ] Clip I I 



Clip 



Clip 



FIG.24A 



Real PlayUst 



CUp 



Real Ray 
list 




Real PlayUst 


1 Real PlayUst | 




• 
• 

• 


* * 

• • 

r f \ 


« 

« 

f 


* ■ t 
» ■ • 

• • • 

• < • 

• 1 * 


1 Clip 


1 1 Clip 


fl CUp 1 



nG.24B 



VirtaalPiayUst | 



Real naylist 



CUp 



Brl< 
Clip 



Real Play 
LUt 





Virtual FlayUstj 








Real PlayUst Real PlayUs>t 


t *» 
• » 
« • 
» I 
• 1 




1 t « Ml 





CUp 



f I ' Clip 1 



FIG.24C 



GNSDOCID: <EP 1106133A1J_> 



56 



EP1 198133A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIAHON 


FlasrUstOf 






versioiLJDiimber 


8*4 


bslbf 




32 


uimsbf 


nayUst type 


8 


uimsbf 


GPI type 


1 


bslbf 


reserved 


7 


bslbf 


UlAppInfoPlayListO 






numb«> of Pla^Items //main path 


16 


uimsbf 


H i<Vertual PUxyUsr>y{ 






numbor (rflSnbFlayltems //sub path 


16 


uimsbf 


}el8e( 






reserved 


16 


bslbf 


J 






for (f*UtyltemJd=0: 

PlayltemJd<nymber_ofJ*layItem5: 

Playltem W++){ 






Playltemd //main path 






) 






If (<Virtmil PiayLisr>) { 






if (CPl type-"0 && PlayLi8t_type~0) ( 






for G-0: i<mmU>er of JSubPlayltemr, i++) 






SabPiayltemO //sub path 






} 






} 






1 







FIG.25 



57 



EP 1 198 133 A1 



PlayU8t_type 


MEANING 


0 


PIAY UST FOR AV RECORDING 

ALL CUPS REFERENCED IN THIS PLAY UST MUST 
CONTAIN ONE OR MORE VIDEO STREAMS 


1 


PLAY UST FOR AUDIO RECORDING 
ALL CUPS REFERENCED IN THIS PLAYUST MUST 
CONTAIN ONE OR MORE AUDIO STREAMS AND MUST 
NOT CONTAIN VIDEO STREAMS 


2-255 


reservisd 



FIG.26 



BNSOOCID: <EP 1198133^1 J_> 



58 



EP 1 198 133 A1 



SYNTAX 


OF BYTES 


ABBREmnON 


UIAppInfoPlaylist20 1 






cbaracter^et 


8 


bslbf 


namejength 


8 


uimsbf 




8*256 


bslbf 


reserved 


8 


bslbf 


record^tfrne^andLdate 


4*14 


bslbf 


reservi^ 


8 . 


bslbf 


duratfon. 


4*6 


bslbf 


valldLperiod 


4*8 


bslbf 


maker^d 


16 


uimsbf 


ihaker.code 


16 


uim^f 


reserved 


11 


bslbf 


ptayback.cpntrol.flag 


1 


bslbf 


wrlte_protect_flag 


1 


bslbf 


isj[»biyeiLllag ' 


1 


bslbf 


archive 


2 


bslbf 


rdLthiunbnallJnidex 


16 


uimsbf 


reservedLfor^ture^use 


256 


bslbf 


\ 







FIG.27 



iteei38Aij^ 



59 



EP1 198 133 A1 



writejprotect^flag 


MEANING 


Ob 


THE PlayUst CAN BE ERASED FREELY 


lb 


THE PlayUst CONTENTS SHOULD NOT BE ERASED 
NOR CHANGED EXCEPT vnite-protect-flae 



FIG.28A 



iS-Playedjflag 


MEANING 


Ob 


THE PlayList HAS NOT BEEN REPRODUCED SINCE 
rrS RECORDING 


lb 


THE PlayUst WAS ONCE REPRODUCED SINCE ITS 
RECORDING 



FIQ.28B 



archive 


MEANING 


00b 


NO MEANING DEFINED 


01b 


ORIGINAL 


10b 


COPY 


lib 


reserved 



FIG.28C 



BN80OCID: <EP 11flei3aA1J_> 



eo 



EP 1 1M 133 A1 




mm^m 





EP1 198 133 A1 




EP1 198 133 A1 




63 



EP1 198 133 A1 



SYNTAX 


NUMBER 
OF BYTES 


ABBREVIATION 


PlayItemO( 






CUpJnfoniiatlon^e.juime 


8*10 


bslbf 


reserved 


24 


bslbf 


STC_^uenceJd 


8 


uimsbf 


IN^time 


32 


uimsbf 


. OUT^tline 


32 


uimsbf 


reserved 


14 


bslbf 


connection.condiUon 


2 


bslbf 


If (<VirtualPlayUst>)( 






if ieonnectionjcondltion=^l&^[ 






BridgeSequencdnfoO 






1 






) 






\ 







FIG.32 



BNSOOCID: <6P 1196133^1 J.> 



64 



EP1 198133A1 



in the PlayUstO 


SEMANTICS OF IN_time 


EP^ihap type 


IN.tiroe MUST INDICATE UPPER 32 BITS OF 33 BIT 
LENGTH CORRESPONDING TO FIRST PRESENTATION 
: UNTTIN Flayltem 


TUjnap type 


IN^time MUST BE TIME ON TU_map_tiinc_axi8, AND 
MUST BE ROUNDED TO time_unit PRECISION. IN-time IS 
CAIXJUIATED BY FOIIjOWING EQUATION: 

IN.time - TU^8tart_time 



FIG.33 



65 



EP1 1M133A1 



CPI_type 
inthePlaylistO 


SEMANTICS OF OinLtime 


EPjaiaptype 


OUT.Ume MUST INDICATE UPPER 32 BITS OF THE 
VALUE OF Presentation.endjrS CALCULATED BY 
FOLLOWING EQUnON: 

Presentation^end jrs - PTS„out+AU_duratlon 

WHERE PTS_out IS 33-BIT LONG PTS CORRESPONDING 
TO LAST PRESENTATION UNIT IN Playltem. AU.duraUon 
IS 90 kHj^-DISPLAYTlME OF LAST PRESENTATION UNIT. 


TU_map type 


OUT_time MUST BE TIME ON TU_map„Ume_axi8 AND BE 
ROUNDED TO tlme_unit PRECISION. OUTLtlme IS 
CALCULATED BY FOLLOWING EQUATION: 

OUT_time - TU^startLtime 



FIG.34 



66 

BNSDOCID: <EP noei33AlJ_> 



EP 1 198 133 A1 



I 

.•I 

i 

i. 

s 



connection 
.condition 


MEANING 


00 


• CONNECTION OF PREVIOUS Playltem TO CURRENT 
Playltem IS NOT SURE AS TO SEAMLESS REPLAY. 

• IF CPI.type OF PlayUst IS TU_map type, THIS VALUE MUST 
BE SETIN connection^condition. 


01 


• THIS STATE IS ALLOWED ONLY WHEN CPUtype OF 
Playlist IS EPjnap type/ 
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STREAM MUST OBEY DVR-STD AS LATER DESCRIBED. 
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• PREVIOUS Playltem IS CONNECTED TO CURRENT 
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TRANSPORT STREAM MUST OBEY DVR-STD AS LATER 
DESCRIBED. 
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